<!DOCTYPE html>
<html lang="en-US">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<title>create_dl_layer_batch_normalization [HALCON算子参考手册]</title>
<style type="text/css">
      body {
    color: #000000;
    background-color: #ffffff;
    margin: 0;
    font-family: Arial, Helvetica, sans-serif;
}

.body_main {
    margin-left: 35px;
    margin-right: 35px;
}

@media screen and (min-width:992px) {

    .body_main {
        margin-left: 10%;
        margin-right: 10%;
    }

    table.toctable {
        width: 80%
    }
}

@media screen and (min-width:1400px) {

    .body_main {
        margin-left: 15%;
        margin-right: 15%;
    }

    table.toctable {
        width: 70%
    }
}

body>div ul ul {
    margin-left: inherit;
}

a:link {
    color: #0044cc;
}

a:link,
a:visited {
    text-decoration: none;
}

a:link:hover,
a:visited:hover {
    text-decoration: underline;
}

th {
    text-align: left;
}

h1,
h2,
h3,
h4,
h5,
h6 {
    text-rendering: optimizeLegibility;
    color: #666666;
}

code {
    font-family: monospace,monospace;
}

h1 a.halconoperator {
    font-family: Arial, Helvetica, sans-serif;
    color: #666666;
}

h2 a.halconoperator {
    font-family: Arial, Helvetica, sans-serif;
    color: #666666;
}

hr {
    border: 0;
    border-top: solid 1px #f28d26;
}

.pre {
    display: block;
    padding-bottom: 1ex;
    font-family: monospace;
    white-space: pre;
}

pre {
    font-family: monospace, monospace;
    padding: 1ex;
    white-space: pre-wrap;
}

.toc {
    font-size: 80%;
    border-top: 1px dashed #f28d26;
    border-bottom: 1px dashed #f28d26;
    padding-top: 5px;
    padding-bottom: 5px;
}

.inv {
    margin: 0;
    border: 0;
    padding: 0;
}

.banner {
    color: #666666;
    padding-left: 1em;
}

.logo {
    background-color: white;
}

.keyboard {
    font-size: 80%;
    padding-left: 3px;
    padding-right: 3px;
    border-radius: 5px;
    border-width: 1px;
    border-style: solid;
    border-color: #f28d26;
    background-color: #f3f3f3;
}

.warning {
    margin-top: 2ex;
    margin-bottom: 1ex;
    padding: 10px;
    text-align: center;
    border: 1px solid;
    color: #bb0000;
    background-color: #fff7f7
}

.imprint {
    margin-top: 1ex;
    font-size: 80%;
    color: #666666;
}

.imprinthead {
    font-weight: bolder;
    color: #666666;
}

.indexlink {
    text-align: right;
    padding-bottom: 5px;
}

.postscript {
    margin-top: 2ex;
    font-size: 80%;
    color: #666666
}

.evenrow {
    background-color: #e7e7ef;
    vertical-align: top;
}

.oddrow {
    background-color: #f7f7ff;
    vertical-align: top;
}

.headrow {
    background-color: #97979f;
    color: #ffffff;
    vertical-align: top;
}

.logorow {
    vertical-align: top;
}

.error {
    color: red;
}

.var {
    font-style: italic
}

.halconoperator {
    font-family: monospace, monospace;
}

span.operator {
    font-family: monospace, monospace;
}

span.procedure {
    font-family: monospace, monospace;
}

span.operation {
    font-family: monospace, monospace;
}

span.feature {
    font-family: Arial, Helvetica, Homerton, sans-serif;
}

ul {
    padding-left: 1.2em;
}

li.dot {
    list-style-type: square;
    color: #f28d26;
}

.breadcrumb {
    font-size: 80%;
    color: white;
    background-color: #062d64;
    margin-bottom: 20px;
    padding-left: 35px;
    padding-right: 35px;
    padding-bottom: 15px;
}

.webbar {
    font-size: 80%;
    background-color: #dddddd;
    margin-top: 0px;
    margin-left: -35px;
    margin-right: -35px;
    margin-bottom: 0px;
    padding-top: 5px;
    padding-left: 35px;
    padding-right: 35px;
    padding-bottom: 5px;
}

.footer {
    display: flex;
    flex-wrap: wrap;
    justify-content: space-between;
    border-top: 1px dashed #f28d26;
    font-size: 80%;
    color: #666666;
    padding-bottom: 8px;
}

.footer .socialmedia a {
    padding-left: 7px;
}

.socialmedia {
    padding-top: 10px;
}

.copyright {
    margin-top: 19px;
}

.breadcrumb a {
    color: #ffffff;
    border-bottom: 1px solid white;
}

.breadcrumb a:link:hover,
.breadcrumb a:visited:hover {
    text-decoration: none;
    border-bottom: none;
}

.heading {
    margin-top: 1ex;
    font-size: 110%;
    font-weight: bold;
    color: #666666;
}

.text {
    color: black;
}

.example {
    font-size: 80%;
    background-color: #f3f3f3;
    border: 1px dashed #666666;
    padding: 10px;
}

.displaymath {
    display: block;
    text-align: center;
    margin-top: 1ex;
    margin-bottom: 1ex;
}

.title {
    float: left;
    padding-top: 3px;
    padding-bottom: 3px;
}

.signnote {
    font-family: Arial, Helvetica, Homerton, sans-serif;
    font-size: 80%;
    color: #666666;
    font-weight: lighter;
    font-style: italic
}

.par {
    margin-bottom: 1.5em;
}

.parhead {
    text-align: right;
}

.parname {
    float: left;
}

.pardesc {
    font-size: 85%;
    margin-top: 0.5em;
    margin-bottom: 0.5em;
    margin-left: 2em;
}

.parcat {
    color: #666;
    font-weight: bold;
}

*[data-if=cpp],
*[data-if=c],
*[data-if=dotnet],
*[data-if=com],
*[data-if=python] {
    display: none;
}

.tabbar {
    text-align: right;
    border-bottom: 1px solid #f28d26;
    margin-bottom: 0.5em;
}

ul.tabs {
    padding-top: 3px;
    padding-bottom: 3px;
    margin-top: 10px;
    margin-bottom: 0;
    font-size: 80%
}

ul.tabs li {
    padding-top: 3px;
    padding-bottom: 3px;
    display: inline;
    overflow: hidden;
    list-style-type: none;
    margin: 0;
    margin-left: 8px;
    border-top: 1px solid #666;
    border-left: 1px solid #666;
    border-right: 1px solid #666;
}

ul.tabs li.active {
    border-left: 1px solid #f28d26;
    border-right: 1px solid #f28d26;
    border-top: 1px solid #f28d26;
    border-bottom: 1px solid #fff;
}

ul.tabs li.inactive {
    background-color: #eee;
}

ul.tabs li a {
    padding-left: 5px;
    padding-right: 5px;
    color: #666;
}

ul.tabs li a:link:hover {
    text-decoration: none;
}

ul.tabs li.inactive a {
    color: #666;
}

ul.tabs li.active a {
    color: black;
}

dl.generic dd {
    margin-bottom: 1em;
}

.pari {
    color: olive;
}

.paro {
    color: maroon;
}

.comment {
    font-size: 80%;
    color: green;
    white-space: nowrap;
}

table.grid {
    border-collapse: collapse;
}

table.grid td {
    padding: 5px;
    border: 1px solid;
}

table.layout {
    border: 0px;
}

table.layout td {
    padding: 5px;
}

table.table {
    border-collapse: collapse;
}

table.table td {
    padding: 5px;
    border-left: 0px;
    border-right: 0px;
}

table.table tr:last-child {
    border-bottom: 1px solid;
}

table.table th {
    padding: 5px;
    border-top: 1px solid;
    border-bottom: 1px solid;
    border-left: 0px;
    border-right: 0px;
}

.details_summary {
    cursor: pointer;
}

table.toctable {
    width: 100%;
}

table.toctable col:first-child {
    width: 20%;
}

table.toctable col:nth-last-child(2) {
    width: 8%;
}

table.altcolored tr:nth-child(even) {
    background-color: #f3f3f3;
}

    </style>
<!--OP_REF_STYLE_END-->
<script>
    <!--
var active_lang='hdevelop';function switchVisibility(obj,active_lang,new_lang)
{var display_style='inline';
for(var i=0;i<obj.length;i++)
{if(obj.item(i).getAttribute('data-if')==new_lang)
{obj.item(i).style.display=display_style;}
if(obj.item(i).getAttribute('data-if')==active_lang)
{obj.item(i).style.display='none';}}
return;}
function toggleLanguage(new_lang,initial)
{if(active_lang!=new_lang)
{var lis=document.getElementsByTagName('li');for(var i=0;i<lis.length;i++)
{if(lis.item(i).id=='syn-'+new_lang)
{lis.item(i).className='active';}
else
{lis.item(i).className='inactive';}}
var divs=document.getElementsByTagName('div');var spans=document.getElementsByTagName('span');switchVisibility(divs,active_lang,new_lang);switchVisibility(spans,active_lang,new_lang);if(!initial)
{setCookie("halcon_reference_language",new_lang,null,null);}
active_lang=new_lang;}
return;}
function setCookie(name,value,domain,exp_offset,path,secure)
{localStorage.setItem(name,value);}
function getCookie(name)
{return localStorage.getItem(name);}
function initialize()
{var qs=location.href.split('?')[1];var qs_lang_raw=location.href.split('interface=')[1];var qs_lang;if(qs_lang_raw)
{qs_lang=qs_lang_raw.split('#')[0];}
var cookie_lang=getCookie("halcon_reference_language");var new_lang;if((qs_lang=="hdevelop")||(qs_lang=="dotnet")||(qs_lang=="python")||(qs_lang=="cpp")||(qs_lang=="c"))
{new_lang=qs_lang;setCookie("halcon_reference_language",new_lang,null,null);}
else if((cookie_lang=="hdevelop")||(cookie_lang=="dotnet")||(cookie_lang=="python")||(cookie_lang=="cpp")||(cookie_lang=="c"))
{new_lang=cookie_lang;}
else
{new_lang="hdevelop";}
toggleLanguage(new_lang,1);return;}
-->

  </script>
</head>
<body onload="initialize();">
<div class="breadcrumb">
<br class="inv"><a href="index.html">目录</a> / <a href="toc_deeplearning.html">Deep Learning</a> / <a href="toc_deeplearning_framework.html">Framework</a><br class="inv">
</div>
<div class="body_main">
<div class="tabbar"><ul class="tabs">
<li id="syn-hdevelop" class="active"><a href="javascript:void(0);" onclick="toggleLanguage('hdevelop')" onfocus="blur()">HDevelop</a></li>
<li id="syn-dotnet" class="inactive"><a href="javascript:void(0);" onclick="toggleLanguage('dotnet')" onfocus="blur()">.NET</a></li>
<li id="syn-python" class="inactive"><a href="javascript:void(0);" onclick="toggleLanguage('python')" onfocus="blur()">Python</a></li>
<li id="syn-cpp" class="inactive"><a href="javascript:void(0);" onclick="toggleLanguage('cpp')" onfocus="blur()">C++</a></li>
<li id="syn-c" class="inactive"><a href="javascript:void(0);" onclick="toggleLanguage('c')" onfocus="blur()">C</a></li>
</ul></div>
<div class="indexlink">
<a href="index_classes.html"><span data-if="dotnet" style="display:none;">类别</span><span data-if="cpp" style="display:none;">类别</span></a><span data-if="dotnet" style="display:none;"> | </span><span data-if="cpp" style="display:none;"> | </span><a href="index_by_name.html">算子列表</a>
</div>
<!--OP_REF_HEADER_END-->
<h1 id="sec_name">
<span data-if="hdevelop" style="display:inline;">create_dl_layer_batch_normalization</span><span data-if="c" style="display:none;">T_create_dl_layer_batch_normalization</span><span data-if="cpp" style="display:none;">CreateDlLayerBatchNormalization</span><span data-if="dotnet" style="display:none;">CreateDlLayerBatchNormalization</span><span data-if="python" style="display:none;">create_dl_layer_batch_normalization</span> (算子名称)</h1>
<h2>名称</h2>
<p><code><span data-if="hdevelop" style="display:inline;">create_dl_layer_batch_normalization</span><span data-if="c" style="display:none;">T_create_dl_layer_batch_normalization</span><span data-if="cpp" style="display:none;">CreateDlLayerBatchNormalization</span><span data-if="dotnet" style="display:none;">CreateDlLayerBatchNormalization</span><span data-if="python" style="display:none;">create_dl_layer_batch_normalization</span></code> — Create a batch normalization layer.</p>
<h2 id="sec_synopsis">参数签名</h2>
<div data-if="hdevelop" style="display:inline;">
<p>
<code><b>create_dl_layer_batch_normalization</b>( :  : <a href="#DLLayerInput"><i>DLLayerInput</i></a>, <a href="#LayerName"><i>LayerName</i></a>, <a href="#Momentum"><i>Momentum</i></a>, <a href="#Epsilon"><i>Epsilon</i></a>, <a href="#Activation"><i>Activation</i></a>, <a href="#GenParamName"><i>GenParamName</i></a>, <a href="#GenParamValue"><i>GenParamValue</i></a> : <a href="#DLLayerBatchNorm"><i>DLLayerBatchNorm</i></a>)</code></p>
</div>
<div data-if="c" style="display:none;">
<p>
<code>Herror <b>T_create_dl_layer_batch_normalization</b>(const Htuple <a href="#DLLayerInput"><i>DLLayerInput</i></a>, const Htuple <a href="#LayerName"><i>LayerName</i></a>, const Htuple <a href="#Momentum"><i>Momentum</i></a>, const Htuple <a href="#Epsilon"><i>Epsilon</i></a>, const Htuple <a href="#Activation"><i>Activation</i></a>, const Htuple <a href="#GenParamName"><i>GenParamName</i></a>, const Htuple <a href="#GenParamValue"><i>GenParamValue</i></a>, Htuple* <a href="#DLLayerBatchNorm"><i>DLLayerBatchNorm</i></a>)</code></p>
</div>
<div data-if="cpp" style="display:none;">
<p>
<code>void <b>CreateDlLayerBatchNormalization</b>(const HTuple&amp; <a href="#DLLayerInput"><i>DLLayerInput</i></a>, const HTuple&amp; <a href="#LayerName"><i>LayerName</i></a>, const HTuple&amp; <a href="#Momentum"><i>Momentum</i></a>, const HTuple&amp; <a href="#Epsilon"><i>Epsilon</i></a>, const HTuple&amp; <a href="#Activation"><i>Activation</i></a>, const HTuple&amp; <a href="#GenParamName"><i>GenParamName</i></a>, const HTuple&amp; <a href="#GenParamValue"><i>GenParamValue</i></a>, HTuple* <a href="#DLLayerBatchNorm"><i>DLLayerBatchNorm</i></a>)</code></p>
<p>
<code><a href="HDlLayer.html">HDlLayer</a> <a href="HDlLayer.html">HDlLayer</a>::<b>CreateDlLayerBatchNormalization</b>(const HString&amp; <a href="#LayerName"><i>LayerName</i></a>, const HTuple&amp; <a href="#Momentum"><i>Momentum</i></a>, double <a href="#Epsilon"><i>Epsilon</i></a>, const HString&amp; <a href="#Activation"><i>Activation</i></a>, const HTuple&amp; <a href="#GenParamName"><i>GenParamName</i></a>, const HTuple&amp; <a href="#GenParamValue"><i>GenParamValue</i></a>) const</code></p>
<p>
<code><a href="HDlLayer.html">HDlLayer</a> <a href="HDlLayer.html">HDlLayer</a>::<b>CreateDlLayerBatchNormalization</b>(const HString&amp; <a href="#LayerName"><i>LayerName</i></a>, const HString&amp; <a href="#Momentum"><i>Momentum</i></a>, double <a href="#Epsilon"><i>Epsilon</i></a>, const HString&amp; <a href="#Activation"><i>Activation</i></a>, const HString&amp; <a href="#GenParamName"><i>GenParamName</i></a>, const HString&amp; <a href="#GenParamValue"><i>GenParamValue</i></a>) const</code></p>
<p>
<code><a href="HDlLayer.html">HDlLayer</a> <a href="HDlLayer.html">HDlLayer</a>::<b>CreateDlLayerBatchNormalization</b>(const char* <a href="#LayerName"><i>LayerName</i></a>, const char* <a href="#Momentum"><i>Momentum</i></a>, double <a href="#Epsilon"><i>Epsilon</i></a>, const char* <a href="#Activation"><i>Activation</i></a>, const char* <a href="#GenParamName"><i>GenParamName</i></a>, const char* <a href="#GenParamValue"><i>GenParamValue</i></a>) const</code></p>
<p>
<code><a href="HDlLayer.html">HDlLayer</a> <a href="HDlLayer.html">HDlLayer</a>::<b>CreateDlLayerBatchNormalization</b>(const wchar_t* <a href="#LayerName"><i>LayerName</i></a>, const wchar_t* <a href="#Momentum"><i>Momentum</i></a>, double <a href="#Epsilon"><i>Epsilon</i></a>, const wchar_t* <a href="#Activation"><i>Activation</i></a>, const wchar_t* <a href="#GenParamName"><i>GenParamName</i></a>, const wchar_t* <a href="#GenParamValue"><i>GenParamValue</i></a>) const  <span class="signnote">
            (
            Windows only)
          </span></code></p>
</div>
<div data-if="com" style="display:none;"></div>
<div data-if="dotnet" style="display:none;">
<p>
<code>static void <a href="HOperatorSet.html">HOperatorSet</a>.<b>CreateDlLayerBatchNormalization</b>(<a href="HTuple.html">HTuple</a> <a href="#DLLayerInput"><i>DLLayerInput</i></a>, <a href="HTuple.html">HTuple</a> <a href="#LayerName"><i>layerName</i></a>, <a href="HTuple.html">HTuple</a> <a href="#Momentum"><i>momentum</i></a>, <a href="HTuple.html">HTuple</a> <a href="#Epsilon"><i>epsilon</i></a>, <a href="HTuple.html">HTuple</a> <a href="#Activation"><i>activation</i></a>, <a href="HTuple.html">HTuple</a> <a href="#GenParamName"><i>genParamName</i></a>, <a href="HTuple.html">HTuple</a> <a href="#GenParamValue"><i>genParamValue</i></a>, out <a href="HTuple.html">HTuple</a> <a href="#DLLayerBatchNorm"><i>DLLayerBatchNorm</i></a>)</code></p>
<p>
<code><a href="HDlLayer.html">HDlLayer</a> <a href="HDlLayer.html">HDlLayer</a>.<b>CreateDlLayerBatchNormalization</b>(string <a href="#LayerName"><i>layerName</i></a>, <a href="HTuple.html">HTuple</a> <a href="#Momentum"><i>momentum</i></a>, double <a href="#Epsilon"><i>epsilon</i></a>, string <a href="#Activation"><i>activation</i></a>, <a href="HTuple.html">HTuple</a> <a href="#GenParamName"><i>genParamName</i></a>, <a href="HTuple.html">HTuple</a> <a href="#GenParamValue"><i>genParamValue</i></a>)</code></p>
<p>
<code><a href="HDlLayer.html">HDlLayer</a> <a href="HDlLayer.html">HDlLayer</a>.<b>CreateDlLayerBatchNormalization</b>(string <a href="#LayerName"><i>layerName</i></a>, string <a href="#Momentum"><i>momentum</i></a>, double <a href="#Epsilon"><i>epsilon</i></a>, string <a href="#Activation"><i>activation</i></a>, string <a href="#GenParamName"><i>genParamName</i></a>, string <a href="#GenParamValue"><i>genParamValue</i></a>)</code></p>
</div>
<div data-if="python" style="display:none;">
<p>
<code>def <b>create_dl_layer_batch_normalization</b>(<a href="#DLLayerInput"><i>dllayer_input</i></a>: HHandle, <a href="#LayerName"><i>layer_name</i></a>: str, <a href="#Momentum"><i>momentum</i></a>: Union[float, str], <a href="#Epsilon"><i>epsilon</i></a>: float, <a href="#Activation"><i>activation</i></a>: str, <a href="#GenParamName"><i>gen_param_name</i></a>: MaybeSequence[str], <a href="#GenParamValue"><i>gen_param_value</i></a>: MaybeSequence[Union[int, float, str]]) -&gt; HHandle</code></p>
</div>
<h2 id="sec_description">描述</h2>
<p>该算子 <code><span data-if="hdevelop" style="display:inline">create_dl_layer_batch_normalization</span><span data-if="c" style="display:none">create_dl_layer_batch_normalization</span><span data-if="cpp" style="display:none">CreateDlLayerBatchNormalization</span><span data-if="com" style="display:none">CreateDlLayerBatchNormalization</span><span data-if="dotnet" style="display:none">CreateDlLayerBatchNormalization</span><span data-if="python" style="display:none">create_dl_layer_batch_normalization</span></code> creates a batch
normalization layer whose handle is returned in <a href="#DLLayerBatchNorm"><i><code><span data-if="hdevelop" style="display:inline">DLLayerBatchNorm</span><span data-if="c" style="display:none">DLLayerBatchNorm</span><span data-if="cpp" style="display:none">DLLayerBatchNorm</span><span data-if="com" style="display:none">DLLayerBatchNorm</span><span data-if="dotnet" style="display:none">DLLayerBatchNorm</span><span data-if="python" style="display:none">dllayer_batch_norm</span></code></i></a>.
Batch normalization is used to improve the performance and stability of a
neural network during training.
The mean and variance of each input activation are calculated for each batch
and the input values are transformed to have zero mean and unit variance.
Moreover, a linear scale and shift transformation is learned. During training,
to take all samples into account, the batch-wise calculated mean
and variance values are combined with a <a href="#Momentum"><i><code><span data-if="hdevelop" style="display:inline">Momentum</span><span data-if="c" style="display:none">Momentum</span><span data-if="cpp" style="display:none">Momentum</span><span data-if="com" style="display:none">Momentum</span><span data-if="dotnet" style="display:none">momentum</span><span data-if="python" style="display:none">momentum</span></code></i></a> into running mean
and running variance, where <span title="1" style="vertical-align:-0.0785312em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.469221em" height="0.782062em" viewBox="0 0 7.507538 12.513000">
<!-- Original BoundingBox: -3.753769 -6.256500 3.753769 6.256500 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_105">
      <path style="fill-rule: evenodd;" d="M284.000000 -625.000000C284.000000 -645.000000,270.000000 -661.000000,247.000000 -661.000000C220.000000 -661.000000,193.000000 -635.000000,193.000000 -608.000000C193.000000 -589.000000,207.000000 -572.000000,231.000000 -572.000000C254.000000 -572.000000,284.000000 -595.000000,284.000000 -625.000000M208.000000 -249.000000C220.000000 -278.000000,220.000000 -280.000000,230.000000 -307.000000C238.000000 -327.000000,243.000000 -341.000000,243.000000 -360.000000C243.000000 -405.000000,211.000000 -442.000000,161.000000 -442.000000C67.000000 -442.000000,29.000000 -297.000000,29.000000 -288.000000C29.000000 -278.000000,39.000000 -278.000000,41.000000 -278.000000C51.000000 -278.000000,52.000000 -280.000000,57.000000 -296.000000C84.000000 -390.000000,124.000000 -420.000000,158.000000 -420.000000C166.000000 -420.000000,183.000000 -420.000000,183.000000 -388.000000C183.000000 -367.000000,176.000000 -346.000000,172.000000 -336.000000C164.000000 -310.000000,119.000000 -194.000000,103.000000 -151.000000C93.000000 -125.000000,80.000000 -92.000000,80.000000 -71.000000C80.000000 -24.000000,114.000000 11.000000,162.000000 11.000000C256.000000 11.000000,293.000000 -134.000000,293.000000 -143.000000C293.000000 -153.000000,284.000000 -153.000000,281.000000 -153.000000C271.000000 -153.000000,271.000000 -150.000000,266.000000 -135.000000C248.000000 -72.000000,215.000000 -11.000000,164.000000 -11.000000C147.000000 -11.000000,140.000000 -21.000000,140.000000 -44.000000C140.000000 -69.000000,146.000000 -83.000000,169.000000 -144.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.262222 11.256500)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_105"></use>
  </g>
</svg></span> denotes the iteration index:
<span title="2" class="displaymath"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="45.4795em" height="5.05653em" viewBox="0 0 727.672058 80.904449">
<!-- Original BoundingBox: -363.836029 -40.452225 363.836029 40.452225 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_77">
      <path style="fill-rule: evenodd;" d="M326.000000 -169.000000L483.000000 -522.000000L491.000000 -522.000000L491.000000 -41.000000L417.000000 -41.000000C399.000000 -41.000000,390.000000 -34.000000,390.000000 -21.000000C390.000000 -7.000000,399.000000 -0.000000,417.000000 -0.000000L566.000000 -0.000000C584.000000 -0.000000,593.000000 -7.000000,593.000000 -21.000000C593.000000 -34.000000,584.000000 -41.000000,566.000000 -41.000000L532.000000 -41.000000L532.000000 -522.000000L557.000000 -522.000000C575.000000 -522.000000,584.000000 -529.000000,584.000000 -543.000000C584.000000 -556.000000,575.000000 -563.000000,557.000000 -563.000000L457.000000 -563.000000L303.000000 -215.000000L146.000000 -563.000000L47.000000 -563.000000C29.000000 -563.000000,20.000000 -556.000000,20.000000 -543.000000C20.000000 -529.000000,29.000000 -522.000000,47.000000 -522.000000L72.000000 -522.000000L72.000000 -41.000000L38.000000 -41.000000C20.000000 -41.000000,11.000000 -34.000000,11.000000 -21.000000C11.000000 -7.000000,20.000000 -0.000000,38.000000 -0.000000L187.000000 -0.000000C205.000000 -0.000000,215.000000 -7.000000,215.000000 -21.000000C215.000000 -34.000000,206.000000 -41.000000,187.000000 -41.000000L113.000000 -41.000000L113.000000 -522.000000L121.000000 -522.000000L280.000000 -169.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_101">
      <path style="fill-rule: evenodd;" d="M520.000000 -199.000000C520.000000 -245.000000,517.000000 -264.000000,503.000000 -297.000000C467.000000 -380.000000,387.000000 -431.000000,291.000000 -431.000000C163.000000 -431.000000,63.000000 -338.000000,63.000000 -217.000000C63.000000 -87.000000,170.000000 16.000000,305.000000 16.000000C396.000000 16.000000,516.000000 -31.000000,516.000000 -66.000000C516.000000 -77.000000,507.000000 -86.000000,497.000000 -86.000000C492.000000 -86.000000,488.000000 -84.000000,481.000000 -79.000000C441.000000 -47.000000,368.000000 -25.000000,306.000000 -25.000000C198.000000 -25.000000,118.000000 -94.000000,104.000000 -199.000000M104.000000 -240.000000C122.000000 -332.000000,194.000000 -390.000000,291.000000 -390.000000C388.000000 -390.000000,462.000000 -331.000000,478.000000 -240.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_109">
      <path style="fill-rule: evenodd;" d="M112.000000 -417.000000L38.000000 -417.000000C20.000000 -417.000000,11.000000 -410.000000,11.000000 -397.000000C11.000000 -383.000000,20.000000 -376.000000,38.000000 -376.000000L72.000000 -376.000000L72.000000 -41.000000L38.000000 -41.000000C20.000000 -41.000000,11.000000 -34.000000,11.000000 -21.000000C11.000000 -7.000000,20.000000 -0.000000,37.000000 -0.000000L146.000000 -0.000000C163.000000 -0.000000,173.000000 -7.000000,173.000000 -21.000000C173.000000 -34.000000,164.000000 -41.000000,146.000000 -41.000000L112.000000 -41.000000L112.000000 -308.000000C150.000000 -365.000000,182.000000 -390.000000,217.000000 -390.000000C251.000000 -390.000000,282.000000 -355.000000,282.000000 -316.000000L282.000000 -0.000000L356.000000 -0.000000C374.000000 -0.000000,383.000000 -7.000000,383.000000 -21.000000C383.000000 -34.000000,374.000000 -41.000000,356.000000 -41.000000L322.000000 -41.000000L322.000000 -308.000000C360.000000 -366.000000,390.000000 -390.000000,426.000000 -390.000000C461.000000 -390.000000,492.000000 -357.000000,492.000000 -319.000000L492.000000 -0.000000L566.000000 -0.000000C584.000000 -0.000000,593.000000 -7.000000,593.000000 -21.000000C593.000000 -34.000000,584.000000 -41.000000,566.000000 -41.000000L532.000000 -41.000000L532.000000 -323.000000C532.000000 -382.000000,485.000000 -431.000000,427.000000 -431.000000C386.000000 -431.000000,353.000000 -410.000000,314.000000 -360.000000C292.000000 -408.000000,260.000000 -431.000000,217.000000 -431.000000C175.000000 -431.000000,146.000000 -413.000000,112.000000 -365.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_110">
      <path style="fill-rule: evenodd;" d="M167.000000 -417.000000L92.000000 -417.000000C74.000000 -417.000000,65.000000 -410.000000,65.000000 -397.000000C65.000000 -383.000000,74.000000 -376.000000,92.000000 -376.000000L126.000000 -376.000000L126.000000 -41.000000L81.000000 -41.000000C62.000000 -41.000000,53.000000 -34.000000,53.000000 -21.000000C53.000000 -7.000000,62.000000 -0.000000,81.000000 -0.000000L212.000000 -0.000000C230.000000 -0.000000,239.000000 -7.000000,239.000000 -21.000000C239.000000 -34.000000,230.000000 -41.000000,212.000000 -41.000000L167.000000 -41.000000L167.000000 -294.000000C199.000000 -335.000000,209.000000 -346.000000,224.000000 -357.000000C252.000000 -380.000000,281.000000 -390.000000,319.000000 -390.000000C358.000000 -390.000000,377.000000 -384.000000,401.000000 -364.000000C426.000000 -343.000000,439.000000 -318.000000,439.000000 -288.000000L439.000000 -41.000000L405.000000 -41.000000C387.000000 -41.000000,378.000000 -34.000000,378.000000 -21.000000C378.000000 -7.000000,387.000000 -0.000000,405.000000 -0.000000L514.000000 -0.000000C532.000000 -0.000000,541.000000 -7.000000,541.000000 -21.000000C541.000000 -34.000000,532.000000 -41.000000,514.000000 -41.000000L480.000000 -41.000000L480.000000 -295.000000C480.000000 -372.000000,412.000000 -431.000000,323.000000 -431.000000C261.000000 -431.000000,225.000000 -412.000000,167.000000 -348.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_111">
      <path style="fill-rule: evenodd;" d="M300.000000 -431.000000C173.000000 -431.000000,72.000000 -331.000000,72.000000 -208.000000C72.000000 -83.000000,173.000000 16.000000,300.000000 16.000000C426.000000 16.000000,528.000000 -83.000000,528.000000 -205.000000C528.000000 -332.000000,428.000000 -431.000000,300.000000 -431.000000M300.000000 -390.000000C405.000000 -390.000000,487.000000 -310.000000,487.000000 -205.000000C487.000000 -106.000000,403.000000 -25.000000,300.000000 -25.000000C196.000000 -25.000000,113.000000 -106.000000,113.000000 -208.000000C113.000000 -309.000000,196.000000 -390.000000,300.000000 -390.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_116">
      <path style="fill-rule: evenodd;" d="M186.000000 -417.000000L186.000000 -536.000000C186.000000 -555.000000,180.000000 -563.000000,166.000000 -563.000000C152.000000 -563.000000,145.000000 -554.000000,145.000000 -536.000000L145.000000 -417.000000L71.000000 -417.000000C52.000000 -417.000000,43.000000 -410.000000,43.000000 -397.000000C43.000000 -383.000000,52.000000 -376.000000,71.000000 -376.000000L145.000000 -376.000000L145.000000 -107.000000C145.000000 -32.000000,206.000000 16.000000,300.000000 16.000000C385.000000 16.000000,499.000000 -22.000000,499.000000 -51.000000C499.000000 -61.000000,490.000000 -71.000000,480.000000 -71.000000C475.000000 -71.000000,472.000000 -70.000000,464.000000 -65.000000C425.000000 -42.000000,354.000000 -25.000000,298.000000 -25.000000C229.000000 -25.000000,186.000000 -58.000000,186.000000 -109.000000L186.000000 -376.000000L406.000000 -376.000000C424.000000 -376.000000,433.000000 -383.000000,433.000000 -397.000000C433.000000 -410.000000,424.000000 -417.000000,406.000000 -417.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_117">
      <path style="fill-rule: evenodd;" d="M439.000000 -0.000000L514.000000 -0.000000C532.000000 -0.000000,541.000000 -7.000000,541.000000 -21.000000C541.000000 -34.000000,532.000000 -41.000000,514.000000 -41.000000L480.000000 -41.000000L480.000000 -417.000000L365.000000 -417.000000C346.000000 -417.000000,337.000000 -410.000000,337.000000 -397.000000C337.000000 -383.000000,346.000000 -376.000000,365.000000 -376.000000L439.000000 -376.000000L439.000000 -115.000000C384.000000 -55.000000,323.000000 -25.000000,256.000000 -25.000000C205.000000 -25.000000,165.000000 -65.000000,165.000000 -115.000000L165.000000 -417.000000L70.000000 -417.000000C52.000000 -417.000000,43.000000 -410.000000,43.000000 -397.000000C43.000000 -383.000000,52.000000 -376.000000,70.000000 -376.000000L124.000000 -376.000000L124.000000 -115.000000C124.000000 -36.000000,177.000000 16.000000,257.000000 16.000000C323.000000 16.000000,384.000000 -12.000000,439.000000 -66.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmr10_40">
      <path style="fill-rule: evenodd;" d="M331.000000 240.000000C331.000000 237.000000,331.000000 235.000000,314.000000 218.000000C189.000000 92.000000,157.000000 -97.000000,157.000000 -250.000000C157.000000 -424.000000,195.000000 -598.000000,318.000000 -723.000000C331.000000 -735.000000,331.000000 -737.000000,331.000000 -740.000000C331.000000 -747.000000,327.000000 -750.000000,321.000000 -750.000000C311.000000 -750.000000,221.000000 -682.000000,162.000000 -555.000000C111.000000 -445.000000,99.000000 -334.000000,99.000000 -250.000000C99.000000 -172.000000,110.000000 -51.000000,165.000000 62.000000C225.000000 185.000000,311.000000 250.000000,321.000000 250.000000C327.000000 250.000000,331.000000 247.000000,331.000000 240.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmr10_41">
      <path style="fill-rule: evenodd;" d="M289.000000 -250.000000C289.000000 -328.000000,278.000000 -449.000000,223.000000 -562.000000C163.000000 -685.000000,77.000000 -750.000000,67.000000 -750.000000C61.000000 -750.000000,57.000000 -746.000000,57.000000 -740.000000C57.000000 -737.000000,57.000000 -735.000000,76.000000 -717.000000C174.000000 -618.000000,231.000000 -459.000000,231.000000 -250.000000C231.000000 -79.000000,194.000000 97.000000,70.000000 223.000000C57.000000 235.000000,57.000000 237.000000,57.000000 240.000000C57.000000 246.000000,61.000000 250.000000,67.000000 250.000000C77.000000 250.000000,167.000000 182.000000,226.000000 55.000000C277.000000 -55.000000,289.000000 -166.000000,289.000000 -250.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmr10_43">
      <path style="fill-rule: evenodd;" d="M409.000000 -230.000000L688.000000 -230.000000C702.000000 -230.000000,721.000000 -230.000000,721.000000 -250.000000C721.000000 -270.000000,702.000000 -270.000000,688.000000 -270.000000L409.000000 -270.000000L409.000000 -550.000000C409.000000 -564.000000,409.000000 -583.000000,389.000000 -583.000000C369.000000 -583.000000,369.000000 -564.000000,369.000000 -550.000000L369.000000 -270.000000L89.000000 -270.000000C75.000000 -270.000000,56.000000 -270.000000,56.000000 -250.000000C56.000000 -230.000000,75.000000 -230.000000,89.000000 -230.000000L369.000000 -230.000000L369.000000 50.000000C369.000000 64.000000,369.000000 83.000000,389.000000 83.000000C409.000000 83.000000,409.000000 64.000000,409.000000 50.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmr10_49">
      <path style="fill-rule: evenodd;" d="M294.000000 -640.000000C294.000000 -664.000000,294.000000 -666.000000,271.000000 -666.000000C209.000000 -602.000000,121.000000 -602.000000,89.000000 -602.000000L89.000000 -571.000000C109.000000 -571.000000,168.000000 -571.000000,220.000000 -597.000000L220.000000 -79.000000C220.000000 -43.000000,217.000000 -31.000000,127.000000 -31.000000L95.000000 -31.000000L95.000000 -0.000000L257.000000 -0.000000L130.000000 -3.000000L217.000000 -3.000000L257.000000 -3.000000L297.000000 -3.000000L384.000000 -3.000000L419.000000 -0.000000L419.000000 -31.000000L387.000000 -31.000000C297.000000 -31.000000,294.000000 -42.000000,294.000000 -79.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmr10_61">
      <path style="fill-rule: evenodd;" d="M687.000000 -327.000000C702.000000 -327.000000,721.000000 -327.000000,721.000000 -347.000000C721.000000 -367.000000,702.000000 -367.000000,688.000000 -367.000000L89.000000 -367.000000C75.000000 -367.000000,56.000000 -367.000000,56.000000 -347.000000C56.000000 -327.000000,75.000000 -327.000000,90.000000 -327.000000M688.000000 -133.000000C702.000000 -133.000000,721.000000 -133.000000,721.000000 -153.000000C721.000000 -173.000000,702.000000 -173.000000,687.000000 -173.000000L90.000000 -173.000000C75.000000 -173.000000,56.000000 -173.000000,56.000000 -153.000000C56.000000 -133.000000,75.000000 -133.000000,89.000000 -133.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmsy10_0">
      <path style="fill-rule: evenodd;" d="M659.000000 -230.000000C676.000000 -230.000000,694.000000 -230.000000,694.000000 -250.000000C694.000000 -270.000000,676.000000 -270.000000,659.000000 -270.000000L118.000000 -270.000000C101.000000 -270.000000,83.000000 -270.000000,83.000000 -250.000000C83.000000 -230.000000,101.000000 -230.000000,118.000000 -230.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmsy10_3">
      <path style="fill-rule: evenodd;" d="M275.000000 -427.000000C276.000000 -441.000000,276.000000 -465.000000,250.000000 -465.000000C234.000000 -465.000000,221.000000 -452.000000,224.000000 -439.000000L224.000000 -426.000000L238.000000 -271.000000L110.000000 -364.000000C101.000000 -369.000000,99.000000 -371.000000,92.000000 -371.000000C78.000000 -371.000000,65.000000 -357.000000,65.000000 -343.000000C65.000000 -327.000000,75.000000 -323.000000,85.000000 -318.000000L227.000000 -250.000000L89.000000 -183.000000C73.000000 -175.000000,65.000000 -171.000000,65.000000 -156.000000C65.000000 -141.000000,78.000000 -128.000000,92.000000 -128.000000C99.000000 -128.000000,101.000000 -128.000000,126.000000 -147.000000L238.000000 -228.000000L223.000000 -60.000000C223.000000 -39.000000,241.000000 -34.000000,249.000000 -34.000000C261.000000 -34.000000,276.000000 -41.000000,276.000000 -60.000000L261.000000 -228.000000L389.000000 -135.000000C398.000000 -130.000000,400.000000 -128.000000,407.000000 -128.000000C421.000000 -128.000000,434.000000 -142.000000,434.000000 -156.000000C434.000000 -171.000000,425.000000 -176.000000,413.000000 -182.000000C353.000000 -212.000000,351.000000 -212.000000,272.000000 -249.000000L410.000000 -316.000000C426.000000 -324.000000,434.000000 -328.000000,434.000000 -343.000000C434.000000 -358.000000,421.000000 -371.000000,407.000000 -371.000000C400.000000 -371.000000,398.000000 -371.000000,373.000000 -352.000000L261.000000 -271.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_58">
      <path style="fill-rule: evenodd;" d="M192.000000 -53.000000C192.000000 -82.000000,168.000000 -106.000000,139.000000 -106.000000C110.000000 -106.000000,86.000000 -82.000000,86.000000 -53.000000C86.000000 -24.000000,110.000000 -0.000000,139.000000 -0.000000C168.000000 -0.000000,192.000000 -24.000000,192.000000 -53.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_59">
      <path style="fill-rule: evenodd;" d="M203.000000 -1.000000C203.000000 -67.000000,178.000000 -106.000000,139.000000 -106.000000C106.000000 -106.000000,86.000000 -81.000000,86.000000 -53.000000C86.000000 -26.000000,106.000000 -0.000000,139.000000 -0.000000C151.000000 -0.000000,164.000000 -4.000000,174.000000 -13.000000C177.000000 -15.000000,178.000000 -16.000000,179.000000 -16.000000C180.000000 -16.000000,181.000000 -15.000000,181.000000 -1.000000C181.000000 73.000000,146.000000 133.000000,113.000000 166.000000C102.000000 177.000000,102.000000 179.000000,102.000000 182.000000C102.000000 189.000000,107.000000 193.000000,112.000000 193.000000C123.000000 193.000000,203.000000 116.000000,203.000000 -1.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_97">
      <path style="fill-rule: evenodd;" d="M373.000000 -378.000000C355.000000 -415.000000,326.000000 -442.000000,281.000000 -442.000000C164.000000 -442.000000,40.000000 -295.000000,40.000000 -149.000000C40.000000 -55.000000,95.000000 11.000000,173.000000 11.000000C193.000000 11.000000,243.000000 7.000000,303.000000 -64.000000C311.000000 -22.000000,346.000000 11.000000,394.000000 11.000000C429.000000 11.000000,452.000000 -12.000000,468.000000 -44.000000C485.000000 -80.000000,498.000000 -141.000000,498.000000 -143.000000C498.000000 -153.000000,489.000000 -153.000000,486.000000 -153.000000C476.000000 -153.000000,475.000000 -149.000000,472.000000 -135.000000C455.000000 -70.000000,437.000000 -11.000000,396.000000 -11.000000C369.000000 -11.000000,366.000000 -37.000000,366.000000 -57.000000C366.000000 -79.000000,368.000000 -87.000000,379.000000 -131.000000C390.000000 -173.000000,392.000000 -183.000000,401.000000 -221.000000L437.000000 -361.000000C444.000000 -389.000000,444.000000 -391.000000,444.000000 -395.000000C444.000000 -412.000000,432.000000 -422.000000,415.000000 -422.000000C391.000000 -422.000000,376.000000 -400.000000,373.000000 -378.000000M308.000000 -119.000000C303.000000 -101.000000,303.000000 -99.000000,288.000000 -82.000000C244.000000 -27.000000,203.000000 -11.000000,175.000000 -11.000000C125.000000 -11.000000,111.000000 -66.000000,111.000000 -105.000000C111.000000 -155.000000,143.000000 -278.000000,166.000000 -324.000000C197.000000 -383.000000,242.000000 -420.000000,282.000000 -420.000000C347.000000 -420.000000,361.000000 -338.000000,361.000000 -332.000000C361.000000 -326.000000,359.000000 -320.000000,358.000000 -315.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_99">
      <path style="fill-rule: evenodd;" d="M396.000000 -380.000000C380.000000 -380.000000,366.000000 -380.000000,352.000000 -366.000000C336.000000 -351.000000,334.000000 -334.000000,334.000000 -327.000000C334.000000 -303.000000,352.000000 -292.000000,371.000000 -292.000000C400.000000 -292.000000,427.000000 -316.000000,427.000000 -356.000000C427.000000 -405.000000,380.000000 -442.000000,309.000000 -442.000000C174.000000 -442.000000,41.000000 -299.000000,41.000000 -158.000000C41.000000 -68.000000,99.000000 11.000000,203.000000 11.000000C346.000000 11.000000,430.000000 -95.000000,430.000000 -107.000000C430.000000 -113.000000,424.000000 -120.000000,418.000000 -120.000000C413.000000 -120.000000,411.000000 -118.000000,405.000000 -110.000000C326.000000 -11.000000,217.000000 -11.000000,205.000000 -11.000000C142.000000 -11.000000,115.000000 -60.000000,115.000000 -120.000000C115.000000 -161.000000,135.000000 -258.000000,169.000000 -320.000000C200.000000 -377.000000,255.000000 -420.000000,310.000000 -420.000000C344.000000 -420.000000,382.000000 -407.000000,396.000000 -380.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_101">
      <path style="fill-rule: evenodd;" d="M187.000000 -231.000000C216.000000 -231.000000,290.000000 -233.000000,340.000000 -254.000000C410.000000 -284.000000,415.000000 -343.000000,415.000000 -357.000000C415.000000 -401.000000,377.000000 -442.000000,308.000000 -442.000000C197.000000 -442.000000,46.000000 -345.000000,46.000000 -170.000000C46.000000 -68.000000,105.000000 11.000000,203.000000 11.000000C346.000000 11.000000,430.000000 -95.000000,430.000000 -107.000000C430.000000 -113.000000,424.000000 -120.000000,418.000000 -120.000000C413.000000 -120.000000,411.000000 -118.000000,405.000000 -110.000000C326.000000 -11.000000,217.000000 -11.000000,205.000000 -11.000000C127.000000 -11.000000,118.000000 -95.000000,118.000000 -127.000000C118.000000 -139.000000,119.000000 -170.000000,134.000000 -231.000000M140.000000 -253.000000C179.000000 -405.000000,282.000000 -420.000000,308.000000 -420.000000C355.000000 -420.000000,382.000000 -391.000000,382.000000 -357.000000C382.000000 -253.000000,222.000000 -253.000000,181.000000 -253.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_103">
      <path style="fill-rule: evenodd;" d="M471.000000 -377.000000C472.000000 -383.000000,474.000000 -388.000000,474.000000 -395.000000C474.000000 -412.000000,462.000000 -422.000000,445.000000 -422.000000C435.000000 -422.000000,408.000000 -415.000000,404.000000 -379.000000C386.000000 -416.000000,351.000000 -442.000000,311.000000 -442.000000C197.000000 -442.000000,73.000000 -302.000000,73.000000 -158.000000C73.000000 -59.000000,134.000000 -0.000000,206.000000 -0.000000C265.000000 -0.000000,312.000000 -47.000000,322.000000 -58.000000L323.000000 -57.000000C302.000000 32.000000,290.000000 73.000000,290.000000 75.000000C286.000000 84.000000,252.000000 183.000000,146.000000 183.000000C127.000000 183.000000,94.000000 182.000000,66.000000 173.000000C96.000000 164.000000,107.000000 138.000000,107.000000 121.000000C107.000000 105.000000,96.000000 86.000000,69.000000 86.000000C47.000000 86.000000,15.000000 104.000000,15.000000 144.000000C15.000000 185.000000,52.000000 205.000000,148.000000 205.000000C273.000000 205.000000,345.000000 127.000000,360.000000 67.000000M341.000000 -128.000000C335.000000 -102.000000,312.000000 -77.000000,290.000000 -58.000000C269.000000 -40.000000,238.000000 -22.000000,209.000000 -22.000000C159.000000 -22.000000,144.000000 -74.000000,144.000000 -114.000000C144.000000 -162.000000,173.000000 -280.000000,200.000000 -331.000000C227.000000 -380.000000,270.000000 -420.000000,312.000000 -420.000000C378.000000 -420.000000,392.000000 -339.000000,392.000000 -334.000000C392.000000 -329.000000,390.000000 -323.000000,389.000000 -319.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_105">
      <path style="fill-rule: evenodd;" d="M284.000000 -625.000000C284.000000 -645.000000,270.000000 -661.000000,247.000000 -661.000000C220.000000 -661.000000,193.000000 -635.000000,193.000000 -608.000000C193.000000 -589.000000,207.000000 -572.000000,231.000000 -572.000000C254.000000 -572.000000,284.000000 -595.000000,284.000000 -625.000000M208.000000 -249.000000C220.000000 -278.000000,220.000000 -280.000000,230.000000 -307.000000C238.000000 -327.000000,243.000000 -341.000000,243.000000 -360.000000C243.000000 -405.000000,211.000000 -442.000000,161.000000 -442.000000C67.000000 -442.000000,29.000000 -297.000000,29.000000 -288.000000C29.000000 -278.000000,39.000000 -278.000000,41.000000 -278.000000C51.000000 -278.000000,52.000000 -280.000000,57.000000 -296.000000C84.000000 -390.000000,124.000000 -420.000000,158.000000 -420.000000C166.000000 -420.000000,183.000000 -420.000000,183.000000 -388.000000C183.000000 -367.000000,176.000000 -346.000000,172.000000 -336.000000C164.000000 -310.000000,119.000000 -194.000000,103.000000 -151.000000C93.000000 -125.000000,80.000000 -92.000000,80.000000 -71.000000C80.000000 -24.000000,114.000000 11.000000,162.000000 11.000000C256.000000 11.000000,293.000000 -134.000000,293.000000 -143.000000C293.000000 -153.000000,284.000000 -153.000000,281.000000 -153.000000C271.000000 -153.000000,271.000000 -150.000000,266.000000 -135.000000C248.000000 -72.000000,215.000000 -11.000000,164.000000 -11.000000C147.000000 -11.000000,140.000000 -21.000000,140.000000 -44.000000C140.000000 -69.000000,146.000000 -83.000000,169.000000 -144.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_109">
      <path style="fill-rule: evenodd;" d="M88.000000 -59.000000C85.000000 -44.000000,79.000000 -21.000000,79.000000 -16.000000C79.000000 2.000000,93.000000 11.000000,108.000000 11.000000C120.000000 11.000000,138.000000 3.000000,145.000000 -17.000000C146.000000 -19.000000,158.000000 -66.000000,164.000000 -91.000000L186.000000 -181.000000C192.000000 -203.000000,198.000000 -225.000000,203.000000 -248.000000C207.000000 -265.000000,215.000000 -294.000000,216.000000 -298.000000C231.000000 -329.000000,284.000000 -420.000000,379.000000 -420.000000C424.000000 -420.000000,433.000000 -383.000000,433.000000 -350.000000C433.000000 -325.000000,426.000000 -297.000000,418.000000 -267.000000L390.000000 -151.000000L370.000000 -75.000000C366.000000 -55.000000,357.000000 -21.000000,357.000000 -16.000000C357.000000 2.000000,371.000000 11.000000,386.000000 11.000000C417.000000 11.000000,423.000000 -14.000000,431.000000 -46.000000C445.000000 -102.000000,482.000000 -248.000000,491.000000 -287.000000C494.000000 -300.000000,547.000000 -420.000000,656.000000 -420.000000C699.000000 -420.000000,710.000000 -386.000000,710.000000 -350.000000C710.000000 -293.000000,668.000000 -179.000000,648.000000 -126.000000C639.000000 -102.000000,635.000000 -91.000000,635.000000 -71.000000C635.000000 -24.000000,670.000000 11.000000,717.000000 11.000000C811.000000 11.000000,848.000000 -135.000000,848.000000 -143.000000C848.000000 -153.000000,839.000000 -153.000000,836.000000 -153.000000C826.000000 -153.000000,826.000000 -150.000000,821.000000 -135.000000C806.000000 -82.000000,774.000000 -11.000000,719.000000 -11.000000C702.000000 -11.000000,695.000000 -21.000000,695.000000 -44.000000C695.000000 -69.000000,704.000000 -93.000000,713.000000 -115.000000C732.000000 -167.000000,774.000000 -278.000000,774.000000 -335.000000C774.000000 -400.000000,734.000000 -442.000000,659.000000 -442.000000C584.000000 -442.000000,533.000000 -398.000000,496.000000 -345.000000C495.000000 -358.000000,492.000000 -392.000000,464.000000 -416.000000C439.000000 -437.000000,407.000000 -442.000000,382.000000 -442.000000C292.000000 -442.000000,243.000000 -378.000000,226.000000 -355.000000C221.000000 -412.000000,179.000000 -442.000000,134.000000 -442.000000C88.000000 -442.000000,69.000000 -403.000000,60.000000 -385.000000C42.000000 -350.000000,29.000000 -291.000000,29.000000 -288.000000C29.000000 -278.000000,39.000000 -278.000000,41.000000 -278.000000C51.000000 -278.000000,52.000000 -279.000000,58.000000 -301.000000C75.000000 -372.000000,95.000000 -420.000000,131.000000 -420.000000C147.000000 -420.000000,162.000000 -412.000000,162.000000 -374.000000C162.000000 -353.000000,159.000000 -342.000000,146.000000 -290.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_110">
      <path style="fill-rule: evenodd;" d="M88.000000 -59.000000C85.000000 -44.000000,79.000000 -21.000000,79.000000 -16.000000C79.000000 2.000000,93.000000 11.000000,108.000000 11.000000C120.000000 11.000000,138.000000 3.000000,145.000000 -17.000000C146.000000 -19.000000,158.000000 -66.000000,164.000000 -91.000000L186.000000 -181.000000C192.000000 -203.000000,198.000000 -225.000000,203.000000 -248.000000C207.000000 -265.000000,215.000000 -294.000000,216.000000 -298.000000C231.000000 -329.000000,284.000000 -420.000000,379.000000 -420.000000C424.000000 -420.000000,433.000000 -383.000000,433.000000 -350.000000C433.000000 -288.000000,384.000000 -160.000000,368.000000 -117.000000C359.000000 -94.000000,358.000000 -82.000000,358.000000 -71.000000C358.000000 -24.000000,393.000000 11.000000,440.000000 11.000000C534.000000 11.000000,571.000000 -135.000000,571.000000 -143.000000C571.000000 -153.000000,562.000000 -153.000000,559.000000 -153.000000C549.000000 -153.000000,549.000000 -150.000000,544.000000 -135.000000C524.000000 -67.000000,491.000000 -11.000000,442.000000 -11.000000C425.000000 -11.000000,418.000000 -21.000000,418.000000 -44.000000C418.000000 -69.000000,427.000000 -93.000000,436.000000 -115.000000C455.000000 -168.000000,497.000000 -278.000000,497.000000 -335.000000C497.000000 -402.000000,454.000000 -442.000000,382.000000 -442.000000C292.000000 -442.000000,243.000000 -378.000000,226.000000 -355.000000C221.000000 -411.000000,180.000000 -442.000000,134.000000 -442.000000C88.000000 -442.000000,69.000000 -403.000000,59.000000 -385.000000C43.000000 -351.000000,29.000000 -292.000000,29.000000 -288.000000C29.000000 -278.000000,39.000000 -278.000000,41.000000 -278.000000C51.000000 -278.000000,52.000000 -279.000000,58.000000 -301.000000C75.000000 -372.000000,95.000000 -420.000000,131.000000 -420.000000C151.000000 -420.000000,162.000000 -407.000000,162.000000 -374.000000C162.000000 -353.000000,159.000000 -342.000000,146.000000 -290.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_114">
      <path style="fill-rule: evenodd;" d="M88.000000 -59.000000C85.000000 -44.000000,79.000000 -21.000000,79.000000 -16.000000C79.000000 2.000000,93.000000 11.000000,108.000000 11.000000C120.000000 11.000000,138.000000 3.000000,145.000000 -17.000000C147.000000 -21.000000,181.000000 -157.000000,185.000000 -175.000000C193.000000 -208.000000,211.000000 -278.000000,217.000000 -305.000000C221.000000 -318.000000,249.000000 -365.000000,273.000000 -387.000000C281.000000 -394.000000,310.000000 -420.000000,353.000000 -420.000000C379.000000 -420.000000,394.000000 -408.000000,395.000000 -408.000000C365.000000 -403.000000,343.000000 -379.000000,343.000000 -353.000000C343.000000 -337.000000,354.000000 -318.000000,381.000000 -318.000000C408.000000 -318.000000,436.000000 -341.000000,436.000000 -377.000000C436.000000 -412.000000,404.000000 -442.000000,353.000000 -442.000000C288.000000 -442.000000,244.000000 -393.000000,225.000000 -365.000000C217.000000 -410.000000,181.000000 -442.000000,134.000000 -442.000000C88.000000 -442.000000,69.000000 -403.000000,60.000000 -385.000000C42.000000 -351.000000,29.000000 -291.000000,29.000000 -288.000000C29.000000 -278.000000,39.000000 -278.000000,41.000000 -278.000000C51.000000 -278.000000,52.000000 -279.000000,58.000000 -301.000000C75.000000 -372.000000,95.000000 -420.000000,131.000000 -420.000000C148.000000 -420.000000,162.000000 -412.000000,162.000000 -374.000000C162.000000 -353.000000,159.000000 -342.000000,146.000000 -290.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_117">
      <path style="fill-rule: evenodd;" d="M350.000000 -56.000000C361.000000 -15.000000,396.000000 11.000000,439.000000 11.000000C474.000000 11.000000,497.000000 -12.000000,513.000000 -44.000000C530.000000 -80.000000,543.000000 -141.000000,543.000000 -143.000000C543.000000 -153.000000,534.000000 -153.000000,531.000000 -153.000000C521.000000 -153.000000,520.000000 -149.000000,517.000000 -135.000000C503.000000 -79.000000,484.000000 -11.000000,442.000000 -11.000000C421.000000 -11.000000,411.000000 -24.000000,411.000000 -57.000000C411.000000 -79.000000,423.000000 -126.000000,431.000000 -161.000000L459.000000 -269.000000C462.000000 -284.000000,472.000000 -322.000000,476.000000 -337.000000C481.000000 -360.000000,491.000000 -398.000000,491.000000 -404.000000C491.000000 -422.000000,477.000000 -431.000000,462.000000 -431.000000C457.000000 -431.000000,431.000000 -430.000000,423.000000 -396.000000C404.000000 -323.000000,360.000000 -148.000000,348.000000 -95.000000C347.000000 -91.000000,307.000000 -11.000000,234.000000 -11.000000C182.000000 -11.000000,172.000000 -56.000000,172.000000 -93.000000C172.000000 -149.000000,200.000000 -228.000000,226.000000 -297.000000C238.000000 -327.000000,243.000000 -341.000000,243.000000 -360.000000C243.000000 -405.000000,211.000000 -442.000000,161.000000 -442.000000C66.000000 -442.000000,29.000000 -297.000000,29.000000 -288.000000C29.000000 -278.000000,39.000000 -278.000000,41.000000 -278.000000C51.000000 -278.000000,52.000000 -280.000000,57.000000 -296.000000C82.000000 -383.000000,120.000000 -420.000000,158.000000 -420.000000C167.000000 -420.000000,183.000000 -419.000000,183.000000 -387.000000C183.000000 -363.000000,172.000000 -334.000000,166.000000 -319.000000C129.000000 -220.000000,108.000000 -158.000000,108.000000 -109.000000C108.000000 -14.000000,177.000000 11.000000,231.000000 11.000000C297.000000 11.000000,333.000000 -34.000000,350.000000 -56.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_118">
      <path style="fill-rule: evenodd;" d="M468.000000 -372.000000C468.000000 -426.000000,442.000000 -442.000000,424.000000 -442.000000C399.000000 -442.000000,375.000000 -416.000000,375.000000 -394.000000C375.000000 -381.000000,380.000000 -375.000000,391.000000 -364.000000C412.000000 -344.000000,425.000000 -318.000000,425.000000 -282.000000C425.000000 -240.000000,364.000000 -11.000000,247.000000 -11.000000C196.000000 -11.000000,173.000000 -46.000000,173.000000 -98.000000C173.000000 -154.000000,200.000000 -227.000000,231.000000 -310.000000C238.000000 -327.000000,243.000000 -341.000000,243.000000 -360.000000C243.000000 -405.000000,211.000000 -442.000000,161.000000 -442.000000C67.000000 -442.000000,29.000000 -297.000000,29.000000 -288.000000C29.000000 -278.000000,39.000000 -278.000000,41.000000 -278.000000C51.000000 -278.000000,52.000000 -280.000000,57.000000 -296.000000C86.000000 -397.000000,129.000000 -420.000000,158.000000 -420.000000C166.000000 -420.000000,183.000000 -420.000000,183.000000 -388.000000C183.000000 -363.000000,173.000000 -336.000000,166.000000 -318.000000C122.000000 -202.000000,109.000000 -156.000000,109.000000 -113.000000C109.000000 -5.000000,197.000000 11.000000,243.000000 11.000000C411.000000 11.000000,468.000000 -320.000000,468.000000 -372.000000"></path>
    </g>
    <g transform="scale(0.009963,0.009963)" id="GLYPHptmr8r_95">
      <path style="fill-rule: evenodd;" d="M500.000000 125.000000L500.000000 75.000000L0.000000 75.000000L0.000000 125.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,39.257401 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_114"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,46.891830 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_117"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="5.724676"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="11.727111"></use>
    <use xlink:href="#GLYPHcmmi10_105" x="17.729547"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="21.174722"></use>
    <use xlink:href="#GLYPHcmmi10_103" x="27.177157"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,98.387222 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHptmr8r_95"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,106.357346 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_109"></use>
    <use xlink:href="#GLYPHcmmi10_101" x="8.780266"></use>
    <use xlink:href="#GLYPHcmmi10_97" x="13.436603"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="18.722591"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,145.769165 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_40"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,151.968231 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_105"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,157.459763 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_41"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,179.599060 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_61"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,207.937393 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_40"></use>
    <use xlink:href="#GLYPHcmr10_49" x="3.888963"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,225.648834 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmsy10_0"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,241.589066 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_77"></use>
    <use xlink:href="#GLYPHpcrr8r_111" x="6.000092"></use>
    <use xlink:href="#GLYPHpcrr8r_109" x="12.000185"></use>
    <use xlink:href="#GLYPHpcrr8r_101" x="18.000277"></use>
    <use xlink:href="#GLYPHpcrr8r_110" x="24.000369"></use>
    <use xlink:href="#GLYPHpcrr8r_116" x="30.000462"></use>
    <use xlink:href="#GLYPHpcrr8r_117" x="36.000554"></use>
    <use xlink:href="#GLYPHpcrr8r_109" x="42.000646"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,318.102463 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_41"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,327.843613 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmsy10_3"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,339.355988 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_109"></use>
    <use xlink:href="#GLYPHcmmi10_101" x="8.780266"></use>
    <use xlink:href="#GLYPHcmmi10_97" x="13.436603"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="18.722591"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,378.767807 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_40"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,384.966705 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_105"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,390.458435 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_41"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,400.199585 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_43"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,416.139954 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_77"></use>
    <use xlink:href="#GLYPHpcrr8r_111" x="6.000092"></use>
    <use xlink:href="#GLYPHpcrr8r_109" x="12.000185"></use>
    <use xlink:href="#GLYPHpcrr8r_101" x="18.000277"></use>
    <use xlink:href="#GLYPHpcrr8r_110" x="24.000369"></use>
    <use xlink:href="#GLYPHpcrr8r_116" x="30.000462"></use>
    <use xlink:href="#GLYPHpcrr8r_117" x="36.000554"></use>
    <use xlink:href="#GLYPHpcrr8r_109" x="42.000646"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,496.195450 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmsy10_3"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,507.707825 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_114"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,515.342255 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_117"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="5.724676"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="11.727111"></use>
    <use xlink:href="#GLYPHcmmi10_105" x="17.729547"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="21.174722"></use>
    <use xlink:href="#GLYPHcmmi10_103" x="27.177157"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,566.837646 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHptmr8r_95"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,574.807770 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_109"></use>
    <use xlink:href="#GLYPHcmmi10_101" x="8.780266"></use>
    <use xlink:href="#GLYPHcmmi10_97" x="13.436603"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="18.722591"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,614.219589 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_40"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,620.418655 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_105"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,629.452454 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmsy10_0"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,645.392685 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_49"></use>
    <use xlink:href="#GLYPHcmr10_41" x="5.000095"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,659.561844 35.616394)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_59"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,16.504517 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_114"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,24.138947 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_117"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="5.724676"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="11.727111"></use>
    <use xlink:href="#GLYPHcmmi10_105" x="17.729547"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="21.174722"></use>
    <use xlink:href="#GLYPHcmmi10_103" x="27.177157"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,75.634323 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHptmr8r_95"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,83.604446 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_118"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,91.903046 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_97"></use>
    <use xlink:href="#GLYPHcmmi10_114" x="5.285988"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,107.963257 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_105"></use>
    <use xlink:href="#GLYPHcmmi10_97" x="3.445174"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="8.731162"></use>
    <use xlink:href="#GLYPHcmmi10_99" x="14.733598"></use>
    <use xlink:href="#GLYPHcmmi10_101" x="19.061233"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,145.769165 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_40"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,151.968231 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_105"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,157.459763 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_41"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,179.599060 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_61"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,207.937393 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_40"></use>
    <use xlink:href="#GLYPHcmr10_49" x="3.888963"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,225.648834 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmsy10_0"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,241.589066 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_77"></use>
    <use xlink:href="#GLYPHpcrr8r_111" x="6.000092"></use>
    <use xlink:href="#GLYPHpcrr8r_109" x="12.000185"></use>
    <use xlink:href="#GLYPHpcrr8r_101" x="18.000277"></use>
    <use xlink:href="#GLYPHpcrr8r_110" x="24.000369"></use>
    <use xlink:href="#GLYPHpcrr8r_116" x="30.000462"></use>
    <use xlink:href="#GLYPHpcrr8r_117" x="36.000554"></use>
    <use xlink:href="#GLYPHpcrr8r_109" x="42.000646"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,318.102463 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_41"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,327.843613 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmsy10_3"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,339.355988 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_118"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,347.654572 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_97"></use>
    <use xlink:href="#GLYPHcmmi10_114" x="5.285988"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,363.714798 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_105"></use>
    <use xlink:href="#GLYPHcmmi10_97" x="3.445174"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="8.731162"></use>
    <use xlink:href="#GLYPHcmmi10_99" x="14.733598"></use>
    <use xlink:href="#GLYPHcmmi10_101" x="19.061233"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,401.520706 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_40"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,407.719604 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_105"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,413.211304 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_41"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,422.952469 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_43"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,438.892700 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_77"></use>
    <use xlink:href="#GLYPHpcrr8r_111" x="6.000092"></use>
    <use xlink:href="#GLYPHpcrr8r_109" x="12.000185"></use>
    <use xlink:href="#GLYPHpcrr8r_101" x="18.000277"></use>
    <use xlink:href="#GLYPHpcrr8r_110" x="24.000369"></use>
    <use xlink:href="#GLYPHpcrr8r_116" x="30.000462"></use>
    <use xlink:href="#GLYPHpcrr8r_117" x="36.000554"></use>
    <use xlink:href="#GLYPHpcrr8r_109" x="42.000646"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,518.948349 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmsy10_3"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,530.460724 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_114"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,538.095154 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_117"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="5.724676"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="11.727111"></use>
    <use xlink:href="#GLYPHcmmi10_105" x="17.729547"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="21.174722"></use>
    <use xlink:href="#GLYPHcmmi10_103" x="27.177157"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,589.590530 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHptmr8r_95"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,597.560654 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_118"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,605.859253 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_97"></use>
    <use xlink:href="#GLYPHcmmi10_114" x="5.285988"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,621.919464 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_105"></use>
    <use xlink:href="#GLYPHcmmi10_97" x="3.445174"></use>
    <use xlink:href="#GLYPHcmmi10_110" x="8.731162"></use>
    <use xlink:href="#GLYPHcmmi10_99" x="14.733598"></use>
    <use xlink:href="#GLYPHcmmi10_101" x="19.061233"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,659.725372 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_40"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,665.924271 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_105"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,674.958221 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmsy10_0"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,690.898438 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmr10_49"></use>
    <use xlink:href="#GLYPHcmr10_41" x="5.000095"></use>
  </g>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,705.067612 59.526855)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_58"></use>
  </g>
</svg></span>
To affect the mean and variance values you can set the following options
for <a href="#Momentum"><i><code><span data-if="hdevelop" style="display:inline">Momentum</span><span data-if="c" style="display:none">Momentum</span><span data-if="cpp" style="display:none">Momentum</span><span data-if="com" style="display:none">Momentum</span><span data-if="dotnet" style="display:none">momentum</span><span data-if="python" style="display:none">momentum</span></code></i></a>:
</p>
<dl class="generic">

<dt><b>Given number:</b></dt>
<dd>
<p>
 For example: <i>0.9</i>. This is the default and recommended option.</p>
<p>
<i>Restriction:</i> <i>0</i> <span title="3" style="vertical-align:-0.207493em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.900873em" height="0.894063em" viewBox="0 0 14.413971 14.305008">
<!-- Original BoundingBox: -7.206985 -7.152496 7.206985 7.152512 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmsy10_20">
      <path style="fill-rule: evenodd;" d="M675.000000 -594.000000C686.000000 -599.000000,694.000000 -604.000000,694.000000 -616.000000C694.000000 -627.000000,686.000000 -636.000000,674.000000 -636.000000C669.000000 -636.000000,660.000000 -632.000000,656.000000 -630.000000L103.000000 -369.000000C86.000000 -361.000000,83.000000 -354.000000,83.000000 -346.000000C83.000000 -337.000000,89.000000 -330.000000,103.000000 -324.000000L656.000000 -64.000000C669.000000 -57.000000,671.000000 -57.000000,674.000000 -57.000000C685.000000 -57.000000,694.000000 -66.000000,694.000000 -77.000000C694.000000 -86.000000,690.000000 -92.000000,673.000000 -100.000000L150.000000 -346.000000M659.000000 137.000000C676.000000 137.000000,694.000000 137.000000,694.000000 117.000000C694.000000 97.000000,673.000000 97.000000,658.000000 97.000000L119.000000 97.000000C104.000000 97.000000,83.000000 97.000000,83.000000 117.000000C83.000000 137.000000,101.000000 137.000000,118.000000 137.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.809006 10.985123)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmsy10_20"></use>
  </g>
</svg></span>  <a href="#Momentum"><i><code><span data-if="hdevelop" style="display:inline">Momentum</span><span data-if="c" style="display:none">Momentum</span><span data-if="cpp" style="display:none">Momentum</span><span data-if="com" style="display:none">Momentum</span><span data-if="dotnet" style="display:none">momentum</span><span data-if="python" style="display:none">momentum</span></code></i></a> <span title="4" style="vertical-align:-0.139466em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.900873em" height="0.701033em" viewBox="0 0 14.413971 11.216522">
<!-- Original BoundingBox: -7.206985 -5.608261 7.206985 5.608261 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHcmmi10_60">
      <path style="fill-rule: evenodd;" d="M675.000000 -498.000000C687.000000 -504.000000,694.000000 -509.000000,694.000000 -520.000000C694.000000 -531.000000,685.000000 -540.000000,674.000000 -540.000000C671.000000 -540.000000,669.000000 -540.000000,656.000000 -533.000000L102.000000 -272.000000C91.000000 -267.000000,83.000000 -262.000000,83.000000 -250.000000C83.000000 -238.000000,91.000000 -233.000000,102.000000 -228.000000L656.000000 33.000000C669.000000 40.000000,671.000000 40.000000,674.000000 40.000000C685.000000 40.000000,694.000000 31.000000,694.000000 20.000000C694.000000 9.000000,687.000000 4.000000,675.000000 -2.000000L150.000000 -250.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.809006 8.985062)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHcmmi10_60"></use>
  </g>
</svg></span> <i>1</i>
</p>
</dd>

<dt><b><i><span data-if="hdevelop" style="display:inline">'auto'</span><span data-if="c" style="display:none">"auto"</span><span data-if="cpp" style="display:none">"auto"</span><span data-if="com" style="display:none">"auto"</span><span data-if="dotnet" style="display:none">"auto"</span><span data-if="python" style="display:none">"auto"</span></i>:</b></dt>
<dd><p>
 Combines mean and variance values by a
cumulative moving average. This is only recommended in case the parameters of all previous
layers in the network are frozen, i.e., have a learning rate of <i>0</i>.
</p></dd>

<dt><b><i><span data-if="hdevelop" style="display:inline">'freeze'</span><span data-if="c" style="display:none">"freeze"</span><span data-if="cpp" style="display:none">"freeze"</span><span data-if="com" style="display:none">"freeze"</span><span data-if="dotnet" style="display:none">"freeze"</span><span data-if="python" style="display:none">"freeze"</span></i>:</b></dt>
<dd><p>
 Stops the adjustment of the mean and
variance and their values stay fixed. In this case, the mean and variance are used
during training for normalizing a batch, analogously to how the batch normalization
operates during inference. The parameters of the linear scale and shift
transformation, however, remain learnable.
</p></dd>
</dl>
<p>
<a href="#Epsilon"><i><code><span data-if="hdevelop" style="display:inline">Epsilon</span><span data-if="c" style="display:none">Epsilon</span><span data-if="cpp" style="display:none">Epsilon</span><span data-if="com" style="display:none">Epsilon</span><span data-if="dotnet" style="display:none">epsilon</span><span data-if="python" style="display:none">epsilon</span></code></i></a> is a small offset to the variance and
used to control the numerical stability. Usually its default value should be
adequate.
</p>
<p>The parameter <a href="#DLLayerInput"><i><code><span data-if="hdevelop" style="display:inline">DLLayerInput</span><span data-if="c" style="display:none">DLLayerInput</span><span data-if="cpp" style="display:none">DLLayerInput</span><span data-if="com" style="display:none">DLLayerInput</span><span data-if="dotnet" style="display:none">DLLayerInput</span><span data-if="python" style="display:none">dllayer_input</span></code></i></a> determines the feeding input layer.
</p>
<p>The parameter <a href="#LayerName"><i><code><span data-if="hdevelop" style="display:inline">LayerName</span><span data-if="c" style="display:none">LayerName</span><span data-if="cpp" style="display:none">LayerName</span><span data-if="com" style="display:none">LayerName</span><span data-if="dotnet" style="display:none">layerName</span><span data-if="python" style="display:none">layer_name</span></code></i></a> sets an individual layer name.
Note that if creating a model using <a href="create_dl_model.html"><code><span data-if="hdevelop" style="display:inline">create_dl_model</span><span data-if="c" style="display:none">create_dl_model</span><span data-if="cpp" style="display:none">CreateDlModel</span><span data-if="com" style="display:none">CreateDlModel</span><span data-if="dotnet" style="display:none">CreateDlModel</span><span data-if="python" style="display:none">create_dl_model</span></code></a> each layer of
the created network must have a unique name.
</p>
<p>The parameter <a href="#Activation"><i><code><span data-if="hdevelop" style="display:inline">Activation</span><span data-if="c" style="display:none">Activation</span><span data-if="cpp" style="display:none">Activation</span><span data-if="com" style="display:none">Activation</span><span data-if="dotnet" style="display:none">activation</span><span data-if="python" style="display:none">activation</span></code></i></a> determines whether an activation is
performed after the batch normalization in order to optimize the runtime
performance.
</p>
<ul>
<li>
<p> <i><span data-if="hdevelop" style="display:inline">'relu'</span><span data-if="c" style="display:none">"relu"</span><span data-if="cpp" style="display:none">"relu"</span><span data-if="com" style="display:none">"relu"</span><span data-if="dotnet" style="display:none">"relu"</span><span data-if="python" style="display:none">"relu"</span></i>: perform a ReLU activation after the batch
normalization.</p>
<p>
It is possible to specify an upper bound to the ReLU operation
(see <a href="create_dl_layer_activation.html"><code><span data-if="hdevelop" style="display:inline">create_dl_layer_activation</span><span data-if="c" style="display:none">create_dl_layer_activation</span><span data-if="cpp" style="display:none">CreateDlLayerActivation</span><span data-if="com" style="display:none">CreateDlLayerActivation</span><span data-if="dotnet" style="display:none">CreateDlLayerActivation</span><span data-if="python" style="display:none">create_dl_layer_activation</span></code></a>) via the generic parameter
<i><span data-if="hdevelop" style="display:inline">'upper_bound'</span><span data-if="c" style="display:none">"upper_bound"</span><span data-if="cpp" style="display:none">"upper_bound"</span><span data-if="com" style="display:none">"upper_bound"</span><span data-if="dotnet" style="display:none">"upper_bound"</span><span data-if="python" style="display:none">"upper_bound"</span></i>.
</p>
</li>
<li>
<p> <i><span data-if="hdevelop" style="display:inline">'none'</span><span data-if="c" style="display:none">"none"</span><span data-if="cpp" style="display:none">"none"</span><span data-if="com" style="display:none">"none"</span><span data-if="dotnet" style="display:none">"none"</span><span data-if="python" style="display:none">"none"</span></i>: no activation operation is performed.
</p>
</li>
</ul>
<p>
It is not possible to specify a leaky ReLU or a sigmoid activation function.
Use <a href="create_dl_layer_activation.html"><code><span data-if="hdevelop" style="display:inline">create_dl_layer_activation</span><span data-if="c" style="display:none">create_dl_layer_activation</span><span data-if="cpp" style="display:none">CreateDlLayerActivation</span><span data-if="com" style="display:none">CreateDlLayerActivation</span><span data-if="dotnet" style="display:none">CreateDlLayerActivation</span><span data-if="python" style="display:none">create_dl_layer_activation</span></code></a> instead.
</p>
<p>The following generic parameters <a href="#GenParamName"><i><code><span data-if="hdevelop" style="display:inline">GenParamName</span><span data-if="c" style="display:none">GenParamName</span><span data-if="cpp" style="display:none">GenParamName</span><span data-if="com" style="display:none">GenParamName</span><span data-if="dotnet" style="display:none">genParamName</span><span data-if="python" style="display:none">gen_param_name</span></code></i></a> and the corresponding
values <a href="#GenParamValue"><i><code><span data-if="hdevelop" style="display:inline">GenParamValue</span><span data-if="c" style="display:none">GenParamValue</span><span data-if="cpp" style="display:none">GenParamValue</span><span data-if="com" style="display:none">GenParamValue</span><span data-if="dotnet" style="display:none">genParamValue</span><span data-if="python" style="display:none">gen_param_value</span></code></i></a> are supported:
</p>
<dl class="generic">

<dt><b><i><span data-if="hdevelop" style="display:inline">'bias_filler'</span><span data-if="c" style="display:none">"bias_filler"</span><span data-if="cpp" style="display:none">"bias_filler"</span><span data-if="com" style="display:none">"bias_filler"</span><span data-if="dotnet" style="display:none">"bias_filler"</span><span data-if="python" style="display:none">"bias_filler"</span></i>:</b></dt>
<dd>
<p>

See <a href="create_dl_layer_convolution.html"><code><span data-if="hdevelop" style="display:inline">create_dl_layer_convolution</span><span data-if="c" style="display:none">create_dl_layer_convolution</span><span data-if="cpp" style="display:none">CreateDlLayerConvolution</span><span data-if="com" style="display:none">CreateDlLayerConvolution</span><span data-if="dotnet" style="display:none">CreateDlLayerConvolution</span><span data-if="python" style="display:none">create_dl_layer_convolution</span></code></a> for a detailed explanation of
this parameter and its values.</p>
<p>
<i>List of values:</i> <i><span data-if="hdevelop" style="display:inline">'xavier'</span><span data-if="c" style="display:none">"xavier"</span><span data-if="cpp" style="display:none">"xavier"</span><span data-if="com" style="display:none">"xavier"</span><span data-if="dotnet" style="display:none">"xavier"</span><span data-if="python" style="display:none">"xavier"</span></i>, <i><span data-if="hdevelop" style="display:inline">'msra'</span><span data-if="c" style="display:none">"msra"</span><span data-if="cpp" style="display:none">"msra"</span><span data-if="com" style="display:none">"msra"</span><span data-if="dotnet" style="display:none">"msra"</span><span data-if="python" style="display:none">"msra"</span></i>,
<i><span data-if="hdevelop" style="display:inline">'const'</span><span data-if="c" style="display:none">"const"</span><span data-if="cpp" style="display:none">"const"</span><span data-if="com" style="display:none">"const"</span><span data-if="dotnet" style="display:none">"const"</span><span data-if="python" style="display:none">"const"</span></i>.</p>
<p>
<i>Default:</i> <i><span data-if="hdevelop" style="display:inline">'const'</span><span data-if="c" style="display:none">"const"</span><span data-if="cpp" style="display:none">"const"</span><span data-if="com" style="display:none">"const"</span><span data-if="dotnet" style="display:none">"const"</span><span data-if="python" style="display:none">"const"</span></i>
</p>
</dd>

<dt><b><i><span data-if="hdevelop" style="display:inline">'bias_filler_const_val'</span><span data-if="c" style="display:none">"bias_filler_const_val"</span><span data-if="cpp" style="display:none">"bias_filler_const_val"</span><span data-if="com" style="display:none">"bias_filler_const_val"</span><span data-if="dotnet" style="display:none">"bias_filler_const_val"</span><span data-if="python" style="display:none">"bias_filler_const_val"</span></i>:</b></dt>
<dd>
<p>
 Constant value.</p>
<p>
<i>Restriction:</i> <i><span data-if="hdevelop" style="display:inline">'bias_filler'</span><span data-if="c" style="display:none">"bias_filler"</span><span data-if="cpp" style="display:none">"bias_filler"</span><span data-if="com" style="display:none">"bias_filler"</span><span data-if="dotnet" style="display:none">"bias_filler"</span><span data-if="python" style="display:none">"bias_filler"</span></i> must be set to
<i><span data-if="hdevelop" style="display:inline">'const'</span><span data-if="c" style="display:none">"const"</span><span data-if="cpp" style="display:none">"const"</span><span data-if="com" style="display:none">"const"</span><span data-if="dotnet" style="display:none">"const"</span><span data-if="python" style="display:none">"const"</span></i>.</p>
<p>
<i>Default:</i> <i>0</i>
</p>
</dd>

<dt><b><i><span data-if="hdevelop" style="display:inline">'bias_filler_variance_norm'</span><span data-if="c" style="display:none">"bias_filler_variance_norm"</span><span data-if="cpp" style="display:none">"bias_filler_variance_norm"</span><span data-if="com" style="display:none">"bias_filler_variance_norm"</span><span data-if="dotnet" style="display:none">"bias_filler_variance_norm"</span><span data-if="python" style="display:none">"bias_filler_variance_norm"</span></i>:</b></dt>
<dd>
<p>

See <a href="create_dl_layer_convolution.html"><code><span data-if="hdevelop" style="display:inline">create_dl_layer_convolution</span><span data-if="c" style="display:none">create_dl_layer_convolution</span><span data-if="cpp" style="display:none">CreateDlLayerConvolution</span><span data-if="com" style="display:none">CreateDlLayerConvolution</span><span data-if="dotnet" style="display:none">CreateDlLayerConvolution</span><span data-if="python" style="display:none">create_dl_layer_convolution</span></code></a> for a detailed explanation of
this parameter and its values.</p>
<p>
<i>List of values:</i> <i><span data-if="hdevelop" style="display:inline">'norm_out'</span><span data-if="c" style="display:none">"norm_out"</span><span data-if="cpp" style="display:none">"norm_out"</span><span data-if="com" style="display:none">"norm_out"</span><span data-if="dotnet" style="display:none">"norm_out"</span><span data-if="python" style="display:none">"norm_out"</span></i>, <i><span data-if="hdevelop" style="display:inline">'norm_in'</span><span data-if="c" style="display:none">"norm_in"</span><span data-if="cpp" style="display:none">"norm_in"</span><span data-if="com" style="display:none">"norm_in"</span><span data-if="dotnet" style="display:none">"norm_in"</span><span data-if="python" style="display:none">"norm_in"</span></i>,
<i><span data-if="hdevelop" style="display:inline">'norm_average'</span><span data-if="c" style="display:none">"norm_average"</span><span data-if="cpp" style="display:none">"norm_average"</span><span data-if="com" style="display:none">"norm_average"</span><span data-if="dotnet" style="display:none">"norm_average"</span><span data-if="python" style="display:none">"norm_average"</span></i>, or constant value (in combination with
<i><span data-if="hdevelop" style="display:inline">'bias_filler'</span><span data-if="c" style="display:none">"bias_filler"</span><span data-if="cpp" style="display:none">"bias_filler"</span><span data-if="com" style="display:none">"bias_filler"</span><span data-if="dotnet" style="display:none">"bias_filler"</span><span data-if="python" style="display:none">"bias_filler"</span></i> = <i><span data-if="hdevelop" style="display:inline">'msra'</span><span data-if="c" style="display:none">"msra"</span><span data-if="cpp" style="display:none">"msra"</span><span data-if="com" style="display:none">"msra"</span><span data-if="dotnet" style="display:none">"msra"</span><span data-if="python" style="display:none">"msra"</span></i>).</p>
<p>
<i>Default:</i> <i><span data-if="hdevelop" style="display:inline">'norm_out'</span><span data-if="c" style="display:none">"norm_out"</span><span data-if="cpp" style="display:none">"norm_out"</span><span data-if="com" style="display:none">"norm_out"</span><span data-if="dotnet" style="display:none">"norm_out"</span><span data-if="python" style="display:none">"norm_out"</span></i>
</p>
</dd>

<dt><b><i><span data-if="hdevelop" style="display:inline">'bias_term'</span><span data-if="c" style="display:none">"bias_term"</span><span data-if="cpp" style="display:none">"bias_term"</span><span data-if="com" style="display:none">"bias_term"</span><span data-if="dotnet" style="display:none">"bias_term"</span><span data-if="python" style="display:none">"bias_term"</span></i>:</b></dt>
<dd>
<p>
 Determines whether the created
batch normalization layer has a bias term (<i><span data-if="hdevelop" style="display:inline">'true'</span><span data-if="c" style="display:none">"true"</span><span data-if="cpp" style="display:none">"true"</span><span data-if="com" style="display:none">"true"</span><span data-if="dotnet" style="display:none">"true"</span><span data-if="python" style="display:none">"true"</span></i>) or not
(<i><span data-if="hdevelop" style="display:inline">'false'</span><span data-if="c" style="display:none">"false"</span><span data-if="cpp" style="display:none">"false"</span><span data-if="com" style="display:none">"false"</span><span data-if="dotnet" style="display:none">"false"</span><span data-if="python" style="display:none">"false"</span></i>).</p>
<p>
<i>Default:</i> <i><span data-if="hdevelop" style="display:inline">'true'</span><span data-if="c" style="display:none">"true"</span><span data-if="cpp" style="display:none">"true"</span><span data-if="com" style="display:none">"true"</span><span data-if="dotnet" style="display:none">"true"</span><span data-if="python" style="display:none">"true"</span></i>
</p>
</dd>

<dt><b><i><span data-if="hdevelop" style="display:inline">'is_inference_output'</span><span data-if="c" style="display:none">"is_inference_output"</span><span data-if="cpp" style="display:none">"is_inference_output"</span><span data-if="com" style="display:none">"is_inference_output"</span><span data-if="dotnet" style="display:none">"is_inference_output"</span><span data-if="python" style="display:none">"is_inference_output"</span></i>:</b></dt>
<dd>
<p>

Determines whether <a href="apply_dl_model.html"><code><span data-if="hdevelop" style="display:inline">apply_dl_model</span><span data-if="c" style="display:none">apply_dl_model</span><span data-if="cpp" style="display:none">ApplyDlModel</span><span data-if="com" style="display:none">ApplyDlModel</span><span data-if="dotnet" style="display:none">ApplyDlModel</span><span data-if="python" style="display:none">apply_dl_model</span></code></a> will include the output of this
layer in the dictionary <code><span data-if="hdevelop" style="display:inline">DLResultBatch</span><span data-if="c" style="display:none">DLResultBatch</span><span data-if="cpp" style="display:none">DLResultBatch</span><span data-if="com" style="display:none">DLResultBatch</span><span data-if="dotnet" style="display:none">DLResultBatch</span><span data-if="python" style="display:none">dlresult_batch</span></code> even without specifying this
layer in <code><span data-if="hdevelop" style="display:inline">Outputs</span><span data-if="c" style="display:none">Outputs</span><span data-if="cpp" style="display:none">Outputs</span><span data-if="com" style="display:none">Outputs</span><span data-if="dotnet" style="display:none">outputs</span><span data-if="python" style="display:none">outputs</span></code> (<i><span data-if="hdevelop" style="display:inline">'true'</span><span data-if="c" style="display:none">"true"</span><span data-if="cpp" style="display:none">"true"</span><span data-if="com" style="display:none">"true"</span><span data-if="dotnet" style="display:none">"true"</span><span data-if="python" style="display:none">"true"</span></i>) or not (<i><span data-if="hdevelop" style="display:inline">'false'</span><span data-if="c" style="display:none">"false"</span><span data-if="cpp" style="display:none">"false"</span><span data-if="com" style="display:none">"false"</span><span data-if="dotnet" style="display:none">"false"</span><span data-if="python" style="display:none">"false"</span></i>).</p>
<p>
<i>Default:</i> <i><span data-if="hdevelop" style="display:inline">'false'</span><span data-if="c" style="display:none">"false"</span><span data-if="cpp" style="display:none">"false"</span><span data-if="com" style="display:none">"false"</span><span data-if="dotnet" style="display:none">"false"</span><span data-if="python" style="display:none">"false"</span></i>
</p>
</dd>

<dt><b><i><span data-if="hdevelop" style="display:inline">'learning_rate_multiplier'</span><span data-if="c" style="display:none">"learning_rate_multiplier"</span><span data-if="cpp" style="display:none">"learning_rate_multiplier"</span><span data-if="com" style="display:none">"learning_rate_multiplier"</span><span data-if="dotnet" style="display:none">"learning_rate_multiplier"</span><span data-if="python" style="display:none">"learning_rate_multiplier"</span></i>:</b></dt>
<dd>
<p>
 Multiplier for the learning
rate for this layer that is used during training.
If <i><span data-if="hdevelop" style="display:inline">'learning_rate_multiplier'</span><span data-if="c" style="display:none">"learning_rate_multiplier"</span><span data-if="cpp" style="display:none">"learning_rate_multiplier"</span><span data-if="com" style="display:none">"learning_rate_multiplier"</span><span data-if="dotnet" style="display:none">"learning_rate_multiplier"</span><span data-if="python" style="display:none">"learning_rate_multiplier"</span></i> is set to <i>0.0</i>, the layer is
skipped during training.</p>
<p>
<i>Default:</i> <i>1.0</i>
</p>
</dd>

<dt><b><i><span data-if="hdevelop" style="display:inline">'learning_rate_multiplier_bias'</span><span data-if="c" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="cpp" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="com" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="dotnet" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="python" style="display:none">"learning_rate_multiplier_bias"</span></i>:</b></dt>
<dd>
<p>
 Multiplier for the
learning rate of the bias term. The total bias learning rate is the
product of <i><span data-if="hdevelop" style="display:inline">'learning_rate_multiplier_bias'</span><span data-if="c" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="cpp" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="com" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="dotnet" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="python" style="display:none">"learning_rate_multiplier_bias"</span></i> and
<i><span data-if="hdevelop" style="display:inline">'learning_rate_multiplier'</span><span data-if="c" style="display:none">"learning_rate_multiplier"</span><span data-if="cpp" style="display:none">"learning_rate_multiplier"</span><span data-if="com" style="display:none">"learning_rate_multiplier"</span><span data-if="dotnet" style="display:none">"learning_rate_multiplier"</span><span data-if="python" style="display:none">"learning_rate_multiplier"</span></i>.</p>
<p>
<i>Default:</i> <i>1.0</i>
</p>
</dd>

<dt><b><i><span data-if="hdevelop" style="display:inline">'upper_bound'</span><span data-if="c" style="display:none">"upper_bound"</span><span data-if="cpp" style="display:none">"upper_bound"</span><span data-if="com" style="display:none">"upper_bound"</span><span data-if="dotnet" style="display:none">"upper_bound"</span><span data-if="python" style="display:none">"upper_bound"</span></i>:</b></dt>
<dd>
<p>
 Float value defining an upper bound
for a rectified linear unit.
If the activation layer is part of a model, which has been created using
<a href="create_dl_model.html"><code><span data-if="hdevelop" style="display:inline">create_dl_model</span><span data-if="c" style="display:none">create_dl_model</span><span data-if="cpp" style="display:none">CreateDlModel</span><span data-if="com" style="display:none">CreateDlModel</span><span data-if="dotnet" style="display:none">CreateDlModel</span><span data-if="python" style="display:none">create_dl_model</span></code></a>, the upper bound can be unset. To do so, use
<a href="set_dl_model_layer_param.html"><code><span data-if="hdevelop" style="display:inline">set_dl_model_layer_param</span><span data-if="c" style="display:none">set_dl_model_layer_param</span><span data-if="cpp" style="display:none">SetDlModelLayerParam</span><span data-if="com" style="display:none">SetDlModelLayerParam</span><span data-if="dotnet" style="display:none">SetDlModelLayerParam</span><span data-if="python" style="display:none">set_dl_model_layer_param</span></code></a> and set an empty tuple for
<i><span data-if="hdevelop" style="display:inline">'upper_bound'</span><span data-if="c" style="display:none">"upper_bound"</span><span data-if="cpp" style="display:none">"upper_bound"</span><span data-if="com" style="display:none">"upper_bound"</span><span data-if="dotnet" style="display:none">"upper_bound"</span><span data-if="python" style="display:none">"upper_bound"</span></i>.</p>
<p>
<i>Default:</i> <i>[]</i>
</p>
</dd>

<dt><b><i><span data-if="hdevelop" style="display:inline">'weight_filler'</span><span data-if="c" style="display:none">"weight_filler"</span><span data-if="cpp" style="display:none">"weight_filler"</span><span data-if="com" style="display:none">"weight_filler"</span><span data-if="dotnet" style="display:none">"weight_filler"</span><span data-if="python" style="display:none">"weight_filler"</span></i>:</b></dt>
<dd>
<p>

See <a href="create_dl_layer_convolution.html"><code><span data-if="hdevelop" style="display:inline">create_dl_layer_convolution</span><span data-if="c" style="display:none">create_dl_layer_convolution</span><span data-if="cpp" style="display:none">CreateDlLayerConvolution</span><span data-if="com" style="display:none">CreateDlLayerConvolution</span><span data-if="dotnet" style="display:none">CreateDlLayerConvolution</span><span data-if="python" style="display:none">create_dl_layer_convolution</span></code></a> for a detailed explanation of
this parameter and its values.</p>
<p>
<i>List of values:</i> <i><span data-if="hdevelop" style="display:inline">'xavier'</span><span data-if="c" style="display:none">"xavier"</span><span data-if="cpp" style="display:none">"xavier"</span><span data-if="com" style="display:none">"xavier"</span><span data-if="dotnet" style="display:none">"xavier"</span><span data-if="python" style="display:none">"xavier"</span></i>, <i><span data-if="hdevelop" style="display:inline">'msra'</span><span data-if="c" style="display:none">"msra"</span><span data-if="cpp" style="display:none">"msra"</span><span data-if="com" style="display:none">"msra"</span><span data-if="dotnet" style="display:none">"msra"</span><span data-if="python" style="display:none">"msra"</span></i>,
<i><span data-if="hdevelop" style="display:inline">'const'</span><span data-if="c" style="display:none">"const"</span><span data-if="cpp" style="display:none">"const"</span><span data-if="com" style="display:none">"const"</span><span data-if="dotnet" style="display:none">"const"</span><span data-if="python" style="display:none">"const"</span></i>.</p>
<p>
<i>Default:</i> <i><span data-if="hdevelop" style="display:inline">'const'</span><span data-if="c" style="display:none">"const"</span><span data-if="cpp" style="display:none">"const"</span><span data-if="com" style="display:none">"const"</span><span data-if="dotnet" style="display:none">"const"</span><span data-if="python" style="display:none">"const"</span></i>
</p>
</dd>

<dt><b><i><span data-if="hdevelop" style="display:inline">'weight_filler_const_val'</span><span data-if="c" style="display:none">"weight_filler_const_val"</span><span data-if="cpp" style="display:none">"weight_filler_const_val"</span><span data-if="com" style="display:none">"weight_filler_const_val"</span><span data-if="dotnet" style="display:none">"weight_filler_const_val"</span><span data-if="python" style="display:none">"weight_filler_const_val"</span></i>:</b></dt>
<dd>
<p>

See <a href="create_dl_layer_convolution.html"><code><span data-if="hdevelop" style="display:inline">create_dl_layer_convolution</span><span data-if="c" style="display:none">create_dl_layer_convolution</span><span data-if="cpp" style="display:none">CreateDlLayerConvolution</span><span data-if="com" style="display:none">CreateDlLayerConvolution</span><span data-if="dotnet" style="display:none">CreateDlLayerConvolution</span><span data-if="python" style="display:none">create_dl_layer_convolution</span></code></a> for a detailed explanation of
this parameter and its values.</p>
<p>
<i>Default:</i> <i>1.0</i>
</p>
</dd>

<dt><b><i><span data-if="hdevelop" style="display:inline">'weight_filler_variance_norm'</span><span data-if="c" style="display:none">"weight_filler_variance_norm"</span><span data-if="cpp" style="display:none">"weight_filler_variance_norm"</span><span data-if="com" style="display:none">"weight_filler_variance_norm"</span><span data-if="dotnet" style="display:none">"weight_filler_variance_norm"</span><span data-if="python" style="display:none">"weight_filler_variance_norm"</span></i>:</b></dt>
<dd>
<p>

See <a href="create_dl_layer_convolution.html"><code><span data-if="hdevelop" style="display:inline">create_dl_layer_convolution</span><span data-if="c" style="display:none">create_dl_layer_convolution</span><span data-if="cpp" style="display:none">CreateDlLayerConvolution</span><span data-if="com" style="display:none">CreateDlLayerConvolution</span><span data-if="dotnet" style="display:none">CreateDlLayerConvolution</span><span data-if="python" style="display:none">create_dl_layer_convolution</span></code></a> for a detailed explanation of
this parameter and its values.</p>
<p>
<i>List of values:</i> <i><span data-if="hdevelop" style="display:inline">'norm_in'</span><span data-if="c" style="display:none">"norm_in"</span><span data-if="cpp" style="display:none">"norm_in"</span><span data-if="com" style="display:none">"norm_in"</span><span data-if="dotnet" style="display:none">"norm_in"</span><span data-if="python" style="display:none">"norm_in"</span></i>, <i><span data-if="hdevelop" style="display:inline">'norm_out'</span><span data-if="c" style="display:none">"norm_out"</span><span data-if="cpp" style="display:none">"norm_out"</span><span data-if="com" style="display:none">"norm_out"</span><span data-if="dotnet" style="display:none">"norm_out"</span><span data-if="python" style="display:none">"norm_out"</span></i>,
<i><span data-if="hdevelop" style="display:inline">'norm_average'</span><span data-if="c" style="display:none">"norm_average"</span><span data-if="cpp" style="display:none">"norm_average"</span><span data-if="com" style="display:none">"norm_average"</span><span data-if="dotnet" style="display:none">"norm_average"</span><span data-if="python" style="display:none">"norm_average"</span></i>, or constant value (in combination with
<i><span data-if="hdevelop" style="display:inline">'weight_filler'</span><span data-if="c" style="display:none">"weight_filler"</span><span data-if="cpp" style="display:none">"weight_filler"</span><span data-if="com" style="display:none">"weight_filler"</span><span data-if="dotnet" style="display:none">"weight_filler"</span><span data-if="python" style="display:none">"weight_filler"</span></i> = <i><span data-if="hdevelop" style="display:inline">'msra'</span><span data-if="c" style="display:none">"msra"</span><span data-if="cpp" style="display:none">"msra"</span><span data-if="com" style="display:none">"msra"</span><span data-if="dotnet" style="display:none">"msra"</span><span data-if="python" style="display:none">"msra"</span></i>).</p>
<p>
<i>Default:</i> <i><span data-if="hdevelop" style="display:inline">'norm_in'</span><span data-if="c" style="display:none">"norm_in"</span><span data-if="cpp" style="display:none">"norm_in"</span><span data-if="com" style="display:none">"norm_in"</span><span data-if="dotnet" style="display:none">"norm_in"</span><span data-if="python" style="display:none">"norm_in"</span></i>
</p>
</dd>
</dl>
<p>Certain parameters of layers created using this operator
<code><span data-if="hdevelop" style="display:inline">create_dl_layer_batch_normalization</span><span data-if="c" style="display:none">create_dl_layer_batch_normalization</span><span data-if="cpp" style="display:none">CreateDlLayerBatchNormalization</span><span data-if="com" style="display:none">CreateDlLayerBatchNormalization</span><span data-if="dotnet" style="display:none">CreateDlLayerBatchNormalization</span><span data-if="python" style="display:none">create_dl_layer_batch_normalization</span></code> can be set and retrieved using
further operators.
The following tables give an overview, which parameters can be set
using <a href="set_dl_model_layer_param.html"><code><span data-if="hdevelop" style="display:inline">set_dl_model_layer_param</span><span data-if="c" style="display:none">set_dl_model_layer_param</span><span data-if="cpp" style="display:none">SetDlModelLayerParam</span><span data-if="com" style="display:none">SetDlModelLayerParam</span><span data-if="dotnet" style="display:none">SetDlModelLayerParam</span><span data-if="python" style="display:none">set_dl_model_layer_param</span></code></a> and which ones can be retrieved
using <a href="get_dl_model_layer_param.html"><code><span data-if="hdevelop" style="display:inline">get_dl_model_layer_param</span><span data-if="c" style="display:none">get_dl_model_layer_param</span><span data-if="cpp" style="display:none">GetDlModelLayerParam</span><span data-if="com" style="display:none">GetDlModelLayerParam</span><span data-if="dotnet" style="display:none">GetDlModelLayerParam</span><span data-if="python" style="display:none">get_dl_model_layer_param</span></code></a> or <a href="get_dl_layer_param.html"><code><span data-if="hdevelop" style="display:inline">get_dl_layer_param</span><span data-if="c" style="display:none">get_dl_layer_param</span><span data-if="cpp" style="display:none">GetDlLayerParam</span><span data-if="com" style="display:none">GetDlLayerParam</span><span data-if="dotnet" style="display:none">GetDlLayerParam</span><span data-if="python" style="display:none">get_dl_layer_param</span></code></a>. Note, the
operators <a href="set_dl_model_layer_param.html"><code><span data-if="hdevelop" style="display:inline">set_dl_model_layer_param</span><span data-if="c" style="display:none">set_dl_model_layer_param</span><span data-if="cpp" style="display:none">SetDlModelLayerParam</span><span data-if="com" style="display:none">SetDlModelLayerParam</span><span data-if="dotnet" style="display:none">SetDlModelLayerParam</span><span data-if="python" style="display:none">set_dl_model_layer_param</span></code></a> and <a href="get_dl_model_layer_param.html"><code><span data-if="hdevelop" style="display:inline">get_dl_model_layer_param</span><span data-if="c" style="display:none">get_dl_model_layer_param</span><span data-if="cpp" style="display:none">GetDlModelLayerParam</span><span data-if="com" style="display:none">GetDlModelLayerParam</span><span data-if="dotnet" style="display:none">GetDlModelLayerParam</span><span data-if="python" style="display:none">get_dl_model_layer_param</span></code></a>
require a model created by <a href="create_dl_model.html"><code><span data-if="hdevelop" style="display:inline">create_dl_model</span><span data-if="c" style="display:none">create_dl_model</span><span data-if="cpp" style="display:none">CreateDlModel</span><span data-if="com" style="display:none">CreateDlModel</span><span data-if="dotnet" style="display:none">CreateDlModel</span><span data-if="python" style="display:none">create_dl_model</span></code></a>.
</p>
<div style="text-align:center"><table style="width:95%;margin-left:auto;margin-right:auto" class="table">
<col span="1" style="width:55%;">
<col span="1" style="width:20%;">
<col span="1" style="width:20%;">
<tr>
<th style="text-align:left">
Layer Parameters                                    </th>
<th style="text-align:center">set                            </th>
<th style="text-align:center">get</th>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'activation_mode'</span><span data-if="c" style="display:none">"activation_mode"</span><span data-if="cpp" style="display:none">"activation_mode"</span><span data-if="com" style="display:none">"activation_mode"</span><span data-if="dotnet" style="display:none">"activation_mode"</span><span data-if="python" style="display:none">"activation_mode"</span></i> (<a href="#Activation"><i><code><span data-if="hdevelop" style="display:inline">Activation</span><span data-if="c" style="display:none">Activation</span><span data-if="cpp" style="display:none">Activation</span><span data-if="com" style="display:none">Activation</span><span data-if="dotnet" style="display:none">activation</span><span data-if="python" style="display:none">activation</span></code></i></a>)    </td>
<td style="text-align:center">
<span title="5" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_45">
      <path style="fill-rule: evenodd;" d="M501.000000 -258.000000C519.000000 -258.000000,528.000000 -265.000000,528.000000 -279.000000C528.000000 -292.000000,519.000000 -299.000000,501.000000 -299.000000L99.000000 -299.000000C81.000000 -299.000000,72.000000 -292.000000,72.000000 -279.000000C72.000000 -265.000000,81.000000 -258.000000,99.000000 -258.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_45"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="6" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'epsilon'</span><span data-if="c" style="display:none">"epsilon"</span><span data-if="cpp" style="display:none">"epsilon"</span><span data-if="com" style="display:none">"epsilon"</span><span data-if="dotnet" style="display:none">"epsilon"</span><span data-if="python" style="display:none">"epsilon"</span></i> (<a href="#Epsilon"><i><code><span data-if="hdevelop" style="display:inline">Epsilon</span><span data-if="c" style="display:none">Epsilon</span><span data-if="cpp" style="display:none">Epsilon</span><span data-if="com" style="display:none">Epsilon</span><span data-if="dotnet" style="display:none">epsilon</span><span data-if="python" style="display:none">epsilon</span></code></i></a>)               </td>
<td style="text-align:center">
<span title="7" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_45">
      <path style="fill-rule: evenodd;" d="M501.000000 -258.000000C519.000000 -258.000000,528.000000 -265.000000,528.000000 -279.000000C528.000000 -292.000000,519.000000 -299.000000,501.000000 -299.000000L99.000000 -299.000000C81.000000 -299.000000,72.000000 -292.000000,72.000000 -279.000000C72.000000 -265.000000,81.000000 -258.000000,99.000000 -258.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_45"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="8" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'input_layer'</span><span data-if="c" style="display:none">"input_layer"</span><span data-if="cpp" style="display:none">"input_layer"</span><span data-if="com" style="display:none">"input_layer"</span><span data-if="dotnet" style="display:none">"input_layer"</span><span data-if="python" style="display:none">"input_layer"</span></i> (<a href="#DLLayerInput"><i><code><span data-if="hdevelop" style="display:inline">DLLayerInput</span><span data-if="c" style="display:none">DLLayerInput</span><span data-if="cpp" style="display:none">DLLayerInput</span><span data-if="com" style="display:none">DLLayerInput</span><span data-if="dotnet" style="display:none">DLLayerInput</span><span data-if="python" style="display:none">dllayer_input</span></code></i></a>)      </td>
<td style="text-align:center">
<span title="9" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_45">
      <path style="fill-rule: evenodd;" d="M501.000000 -258.000000C519.000000 -258.000000,528.000000 -265.000000,528.000000 -279.000000C528.000000 -292.000000,519.000000 -299.000000,501.000000 -299.000000L99.000000 -299.000000C81.000000 -299.000000,72.000000 -292.000000,72.000000 -279.000000C72.000000 -265.000000,81.000000 -258.000000,99.000000 -258.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_45"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="10" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'momentum'</span><span data-if="c" style="display:none">"momentum"</span><span data-if="cpp" style="display:none">"momentum"</span><span data-if="com" style="display:none">"momentum"</span><span data-if="dotnet" style="display:none">"momentum"</span><span data-if="python" style="display:none">"momentum"</span></i> (<a href="#Momentum"><i><code><span data-if="hdevelop" style="display:inline">Momentum</span><span data-if="c" style="display:none">Momentum</span><span data-if="cpp" style="display:none">Momentum</span><span data-if="com" style="display:none">Momentum</span><span data-if="dotnet" style="display:none">momentum</span><span data-if="python" style="display:none">momentum</span></code></i></a>)             </td>
<td style="text-align:center">
<span title="11" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="12" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'name'</span><span data-if="c" style="display:none">"name"</span><span data-if="cpp" style="display:none">"name"</span><span data-if="com" style="display:none">"name"</span><span data-if="dotnet" style="display:none">"name"</span><span data-if="python" style="display:none">"name"</span></i> (<a href="#LayerName"><i><code><span data-if="hdevelop" style="display:inline">LayerName</span><span data-if="c" style="display:none">LayerName</span><span data-if="cpp" style="display:none">LayerName</span><span data-if="com" style="display:none">LayerName</span><span data-if="dotnet" style="display:none">layerName</span><span data-if="python" style="display:none">layer_name</span></code></i></a>)                </td>
<td style="text-align:center">
<span title="13" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="14" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'output_layer'</span><span data-if="c" style="display:none">"output_layer"</span><span data-if="cpp" style="display:none">"output_layer"</span><span data-if="com" style="display:none">"output_layer"</span><span data-if="dotnet" style="display:none">"output_layer"</span><span data-if="python" style="display:none">"output_layer"</span></i> (<a href="#DLLayerBatchNorm"><i><code><span data-if="hdevelop" style="display:inline">DLLayerBatchNorm</span><span data-if="c" style="display:none">DLLayerBatchNorm</span><span data-if="cpp" style="display:none">DLLayerBatchNorm</span><span data-if="com" style="display:none">DLLayerBatchNorm</span><span data-if="dotnet" style="display:none">DLLayerBatchNorm</span><span data-if="python" style="display:none">dllayer_batch_norm</span></code></i></a>) </td>
<td style="text-align:center">
<span title="15" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_45">
      <path style="fill-rule: evenodd;" d="M501.000000 -258.000000C519.000000 -258.000000,528.000000 -265.000000,528.000000 -279.000000C528.000000 -292.000000,519.000000 -299.000000,501.000000 -299.000000L99.000000 -299.000000C81.000000 -299.000000,72.000000 -292.000000,72.000000 -279.000000C72.000000 -265.000000,81.000000 -258.000000,99.000000 -258.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_45"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="16" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'shape'</span><span data-if="c" style="display:none">"shape"</span><span data-if="cpp" style="display:none">"shape"</span><span data-if="com" style="display:none">"shape"</span><span data-if="dotnet" style="display:none">"shape"</span><span data-if="python" style="display:none">"shape"</span></i>                                    </td>
<td style="text-align:center">
<span title="17" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_45">
      <path style="fill-rule: evenodd;" d="M501.000000 -258.000000C519.000000 -258.000000,528.000000 -265.000000,528.000000 -279.000000C528.000000 -292.000000,519.000000 -299.000000,501.000000 -299.000000L99.000000 -299.000000C81.000000 -299.000000,72.000000 -292.000000,72.000000 -279.000000C72.000000 -265.000000,81.000000 -258.000000,99.000000 -258.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_45"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="18" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'type'</span><span data-if="c" style="display:none">"type"</span><span data-if="cpp" style="display:none">"type"</span><span data-if="com" style="display:none">"type"</span><span data-if="dotnet" style="display:none">"type"</span><span data-if="python" style="display:none">"type"</span></i>                                     </td>
<td style="text-align:center">
<span title="19" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_45">
      <path style="fill-rule: evenodd;" d="M501.000000 -258.000000C519.000000 -258.000000,528.000000 -265.000000,528.000000 -279.000000C528.000000 -292.000000,519.000000 -299.000000,501.000000 -299.000000L99.000000 -299.000000C81.000000 -299.000000,72.000000 -292.000000,72.000000 -279.000000C72.000000 -265.000000,81.000000 -258.000000,99.000000 -258.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_45"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center">
<span title="20" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>
</td>
</tr>
</table></div>
<div style="text-align:center"><table style="width:95%;margin-left:auto;margin-right:auto" class="table">
<col span="1" style="width:55%;">
<col span="1" style="width:20%;">
<col span="1" style="width:20%;">
<tr>
<th style="text-align:left">
Generic Layer Parameters                       </th>
<th style="text-align:center">set                            </th>
<th style="text-align:center">get</th>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'bias_filler'</span><span data-if="c" style="display:none">"bias_filler"</span><span data-if="cpp" style="display:none">"bias_filler"</span><span data-if="com" style="display:none">"bias_filler"</span><span data-if="dotnet" style="display:none">"bias_filler"</span><span data-if="python" style="display:none">"bias_filler"</span></i>                         </td>
<td style="text-align:center">
<span title="21" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="22" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'bias_filler_const_val'</span><span data-if="c" style="display:none">"bias_filler_const_val"</span><span data-if="cpp" style="display:none">"bias_filler_const_val"</span><span data-if="com" style="display:none">"bias_filler_const_val"</span><span data-if="dotnet" style="display:none">"bias_filler_const_val"</span><span data-if="python" style="display:none">"bias_filler_const_val"</span></i>               </td>
<td style="text-align:center">
<span title="23" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="24" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'bias_filler_variance_norm'</span><span data-if="c" style="display:none">"bias_filler_variance_norm"</span><span data-if="cpp" style="display:none">"bias_filler_variance_norm"</span><span data-if="com" style="display:none">"bias_filler_variance_norm"</span><span data-if="dotnet" style="display:none">"bias_filler_variance_norm"</span><span data-if="python" style="display:none">"bias_filler_variance_norm"</span></i>           </td>
<td style="text-align:center">
<span title="25" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="26" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'bias_term'</span><span data-if="c" style="display:none">"bias_term"</span><span data-if="cpp" style="display:none">"bias_term"</span><span data-if="com" style="display:none">"bias_term"</span><span data-if="dotnet" style="display:none">"bias_term"</span><span data-if="python" style="display:none">"bias_term"</span></i>                           </td>
<td style="text-align:center">
<span title="27" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_45">
      <path style="fill-rule: evenodd;" d="M501.000000 -258.000000C519.000000 -258.000000,528.000000 -265.000000,528.000000 -279.000000C528.000000 -292.000000,519.000000 -299.000000,501.000000 -299.000000L99.000000 -299.000000C81.000000 -299.000000,72.000000 -292.000000,72.000000 -279.000000C72.000000 -265.000000,81.000000 -258.000000,99.000000 -258.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_45"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="28" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'is_inference_output'</span><span data-if="c" style="display:none">"is_inference_output"</span><span data-if="cpp" style="display:none">"is_inference_output"</span><span data-if="com" style="display:none">"is_inference_output"</span><span data-if="dotnet" style="display:none">"is_inference_output"</span><span data-if="python" style="display:none">"is_inference_output"</span></i>                 </td>
<td style="text-align:center">
<span title="29" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="30" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'learning_rate_multiplier'</span><span data-if="c" style="display:none">"learning_rate_multiplier"</span><span data-if="cpp" style="display:none">"learning_rate_multiplier"</span><span data-if="com" style="display:none">"learning_rate_multiplier"</span><span data-if="dotnet" style="display:none">"learning_rate_multiplier"</span><span data-if="python" style="display:none">"learning_rate_multiplier"</span></i>            </td>
<td style="text-align:center">
<span title="31" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="32" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'learning_rate_multiplier_bias'</span><span data-if="c" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="cpp" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="com" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="dotnet" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="python" style="display:none">"learning_rate_multiplier_bias"</span></i>       </td>
<td style="text-align:center">
<span title="33" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="34" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'num_trainable_params'</span><span data-if="c" style="display:none">"num_trainable_params"</span><span data-if="cpp" style="display:none">"num_trainable_params"</span><span data-if="com" style="display:none">"num_trainable_params"</span><span data-if="dotnet" style="display:none">"num_trainable_params"</span><span data-if="python" style="display:none">"num_trainable_params"</span></i>                </td>
<td style="text-align:center">
<span title="35" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_45">
      <path style="fill-rule: evenodd;" d="M501.000000 -258.000000C519.000000 -258.000000,528.000000 -265.000000,528.000000 -279.000000C528.000000 -292.000000,519.000000 -299.000000,501.000000 -299.000000L99.000000 -299.000000C81.000000 -299.000000,72.000000 -292.000000,72.000000 -279.000000C72.000000 -265.000000,81.000000 -258.000000,99.000000 -258.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_45"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="36" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'upper_bound'</span><span data-if="c" style="display:none">"upper_bound"</span><span data-if="cpp" style="display:none">"upper_bound"</span><span data-if="com" style="display:none">"upper_bound"</span><span data-if="dotnet" style="display:none">"upper_bound"</span><span data-if="python" style="display:none">"upper_bound"</span></i>                         </td>
<td style="text-align:center">
<span title="37" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="38" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'weight_filler'</span><span data-if="c" style="display:none">"weight_filler"</span><span data-if="cpp" style="display:none">"weight_filler"</span><span data-if="com" style="display:none">"weight_filler"</span><span data-if="dotnet" style="display:none">"weight_filler"</span><span data-if="python" style="display:none">"weight_filler"</span></i>                       </td>
<td style="text-align:center">
<span title="39" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="40" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'weight_filler_const_val'</span><span data-if="c" style="display:none">"weight_filler_const_val"</span><span data-if="cpp" style="display:none">"weight_filler_const_val"</span><span data-if="com" style="display:none">"weight_filler_const_val"</span><span data-if="dotnet" style="display:none">"weight_filler_const_val"</span><span data-if="python" style="display:none">"weight_filler_const_val"</span></i>             </td>
<td style="text-align:center">
<span title="41" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center"><span title="42" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span></td>
</tr>
<tr>
<td style="text-align:left">
<i><span data-if="hdevelop" style="display:inline">'weight_filler_variance_norm'</span><span data-if="c" style="display:none">"weight_filler_variance_norm"</span><span data-if="cpp" style="display:none">"weight_filler_variance_norm"</span><span data-if="com" style="display:none">"weight_filler_variance_norm"</span><span data-if="dotnet" style="display:none">"weight_filler_variance_norm"</span><span data-if="python" style="display:none">"weight_filler_variance_norm"</span></i>         </td>
<td style="text-align:center">
<span title="43" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>            </td>
<td style="text-align:center">
<span title="44" style="vertical-align:-0.0991602em" class="math"><!-- Created by MetaPost 1.902 on 2023.05.15:2033 --><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" width="0.723753em" height="0.573321em" viewBox="0 0 11.580048 9.173141">
<!-- Original BoundingBox: -5.790024 -4.586578 5.790024 4.586563 -->
  <defs>
    <g transform="scale(0.009963,0.009963)" id="GLYPHpcrr8r_120">
      <path style="fill-rule: evenodd;" d="M329.000000 -219.000000L492.000000 -376.000000L499.000000 -376.000000C517.000000 -376.000000,526.000000 -383.000000,526.000000 -397.000000C526.000000 -410.000000,517.000000 -417.000000,499.000000 -417.000000L389.000000 -417.000000C371.000000 -417.000000,362.000000 -410.000000,362.000000 -397.000000C362.000000 -383.000000,371.000000 -376.000000,389.000000 -376.000000L437.000000 -376.000000L300.000000 -246.000000L166.000000 -376.000000L212.000000 -376.000000C230.000000 -376.000000,239.000000 -383.000000,239.000000 -397.000000C239.000000 -411.000000,230.000000 -417.000000,212.000000 -417.000000L101.000000 -417.000000C83.000000 -417.000000,74.000000 -410.000000,74.000000 -397.000000C74.000000 -383.000000,83.000000 -376.000000,101.000000 -376.000000L108.000000 -376.000000L271.000000 -219.000000L87.000000 -41.000000L78.000000 -41.000000C60.000000 -41.000000,51.000000 -34.000000,51.000000 -21.000000C51.000000 -7.000000,60.000000 -0.000000,78.000000 -0.000000L211.000000 -0.000000C229.000000 -0.000000,238.000000 -7.000000,238.000000 -21.000000C238.000000 -34.000000,229.000000 -41.000000,211.000000 -41.000000L143.000000 -41.000000L300.000000 -190.000000L455.000000 -41.000000L390.000000 -41.000000C372.000000 -41.000000,363.000000 -34.000000,363.000000 -21.000000C363.000000 -7.000000,372.000000 -0.000000,390.000000 -0.000000L522.000000 -0.000000C540.000000 -0.000000,549.000000 -7.000000,549.000000 -21.000000C549.000000 -34.000000,540.000000 -41.000000,522.000000 -41.000000L513.000000 -41.000000"></path>
    </g>
  </defs>
  <g transform="matrix(1.600006,-0.000000,-0.000000,1.600006,0.225967 7.586578)" style="fill: rgb(0.000000%,0.000000%,0.000000%);">
    <use xlink:href="#GLYPHpcrr8r_120"></use>
  </g>
</svg></span>
</td>
</tr>
</table></div>
<h2 id="sec_execution">运行信息</h2>
<ul>
  <li>多线程类型:可重入(与非独占操作符并行运行)。</li>
<li>多线程作用域:全局(可以从任何线程调用)。</li>
  <li>未经并行化处理。</li>
</ul>
<h2 id="sec_parameters">参数表</h2>
  <div class="par">
<div class="parhead">
<span id="DLLayerInput" class="parname"><b><code><span data-if="hdevelop" style="display:inline">DLLayerInput</span><span data-if="c" style="display:none">DLLayerInput</span><span data-if="cpp" style="display:none">DLLayerInput</span><span data-if="com" style="display:none">DLLayerInput</span><span data-if="dotnet" style="display:none">DLLayerInput</span><span data-if="python" style="display:none">dllayer_input</span></code></b> (input_control)  </span><span>dl_layer <code>→</code> <span data-if="dotnet" style="display:none"><a href="HDlLayer.html">HDlLayer</a>, </span><span data-if="dotnet" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="python" style="display:none">HHandle</span><span data-if="cpp" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="c" style="display:none">Htuple</span><span data-if="hdevelop" style="display:inline"> (handle)</span><span data-if="dotnet" style="display:none"> (<i>IntPtr</i>)</span><span data-if="cpp" style="display:none"> (<i>HHandle</i>)</span><span data-if="c" style="display:none"> (<i>handle</i>)</span></span>
</div>
<p class="pardesc">Feeding layer.</p>
</div>
  <div class="par">
<div class="parhead">
<span id="LayerName" class="parname"><b><code><span data-if="hdevelop" style="display:inline">LayerName</span><span data-if="c" style="display:none">LayerName</span><span data-if="cpp" style="display:none">LayerName</span><span data-if="com" style="display:none">LayerName</span><span data-if="dotnet" style="display:none">layerName</span><span data-if="python" style="display:none">layer_name</span></code></b> (input_control)  </span><span>string <code>→</code> <span data-if="dotnet" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="python" style="display:none">str</span><span data-if="cpp" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="c" style="display:none">Htuple</span><span data-if="hdevelop" style="display:inline"> (string)</span><span data-if="dotnet" style="display:none"> (<i>string</i>)</span><span data-if="cpp" style="display:none"> (<i>HString</i>)</span><span data-if="c" style="display:none"> (<i>char*</i>)</span></span>
</div>
<p class="pardesc">Name of the output layer.</p>
</div>
  <div class="par">
<div class="parhead">
<span id="Momentum" class="parname"><b><code><span data-if="hdevelop" style="display:inline">Momentum</span><span data-if="c" style="display:none">Momentum</span><span data-if="cpp" style="display:none">Momentum</span><span data-if="com" style="display:none">Momentum</span><span data-if="dotnet" style="display:none">momentum</span><span data-if="python" style="display:none">momentum</span></code></b> (input_control)  </span><span>string <code>→</code> <span data-if="dotnet" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="python" style="display:none">Union[float, str]</span><span data-if="cpp" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="c" style="display:none">Htuple</span><span data-if="hdevelop" style="display:inline"> (string / </span><span data-if="hdevelop" style="display:inline">real)</span><span data-if="dotnet" style="display:none"> (<i>string</i> / </span><span data-if="dotnet" style="display:none">double)</span><span data-if="cpp" style="display:none"> (<i>HString</i> / </span><span data-if="cpp" style="display:none">double)</span><span data-if="c" style="display:none"> (<i>char*</i> / </span><span data-if="c" style="display:none">double)</span></span>
</div>
<p class="pardesc">Momentum.</p>
<p class="pardesc"><span class="parcat">Default:
      </span>0.9</p>
<p class="pardesc"><span class="parcat">List of values:
      </span>0.9, 0.99, 0.999, <span data-if="hdevelop" style="display:inline">'auto'</span><span data-if="c" style="display:none">"auto"</span><span data-if="cpp" style="display:none">"auto"</span><span data-if="com" style="display:none">"auto"</span><span data-if="dotnet" style="display:none">"auto"</span><span data-if="python" style="display:none">"auto"</span>, <span data-if="hdevelop" style="display:inline">'freeze'</span><span data-if="c" style="display:none">"freeze"</span><span data-if="cpp" style="display:none">"freeze"</span><span data-if="com" style="display:none">"freeze"</span><span data-if="dotnet" style="display:none">"freeze"</span><span data-if="python" style="display:none">"freeze"</span></p>
</div>
  <div class="par">
<div class="parhead">
<span id="Epsilon" class="parname"><b><code><span data-if="hdevelop" style="display:inline">Epsilon</span><span data-if="c" style="display:none">Epsilon</span><span data-if="cpp" style="display:none">Epsilon</span><span data-if="com" style="display:none">Epsilon</span><span data-if="dotnet" style="display:none">epsilon</span><span data-if="python" style="display:none">epsilon</span></code></b> (input_control)  </span><span>number <code>→</code> <span data-if="dotnet" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="python" style="display:none">float</span><span data-if="cpp" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="c" style="display:none">Htuple</span><span data-if="hdevelop" style="display:inline"> (real)</span><span data-if="dotnet" style="display:none"> (<i>double</i>)</span><span data-if="cpp" style="display:none"> (<i>double</i>)</span><span data-if="c" style="display:none"> (<i>double</i>)</span></span>
</div>
<p class="pardesc">Variance offset.</p>
<p class="pardesc"><span class="parcat">Default:
      </span>0.0001</p>
</div>
  <div class="par">
<div class="parhead">
<span id="Activation" class="parname"><b><code><span data-if="hdevelop" style="display:inline">Activation</span><span data-if="c" style="display:none">Activation</span><span data-if="cpp" style="display:none">Activation</span><span data-if="com" style="display:none">Activation</span><span data-if="dotnet" style="display:none">activation</span><span data-if="python" style="display:none">activation</span></code></b> (input_control)  </span><span>string <code>→</code> <span data-if="dotnet" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="python" style="display:none">str</span><span data-if="cpp" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="c" style="display:none">Htuple</span><span data-if="hdevelop" style="display:inline"> (string)</span><span data-if="dotnet" style="display:none"> (<i>string</i>)</span><span data-if="cpp" style="display:none"> (<i>HString</i>)</span><span data-if="c" style="display:none"> (<i>char*</i>)</span></span>
</div>
<p class="pardesc">Optional activation function.</p>
<p class="pardesc"><span class="parcat">Default:
      </span>
    <span data-if="hdevelop" style="display:inline">'none'</span>
    <span data-if="c" style="display:none">"none"</span>
    <span data-if="cpp" style="display:none">"none"</span>
    <span data-if="com" style="display:none">"none"</span>
    <span data-if="dotnet" style="display:none">"none"</span>
    <span data-if="python" style="display:none">"none"</span>
</p>
<p class="pardesc"><span class="parcat">List of values:
      </span><span data-if="hdevelop" style="display:inline">'none'</span><span data-if="c" style="display:none">"none"</span><span data-if="cpp" style="display:none">"none"</span><span data-if="com" style="display:none">"none"</span><span data-if="dotnet" style="display:none">"none"</span><span data-if="python" style="display:none">"none"</span>, <span data-if="hdevelop" style="display:inline">'relu'</span><span data-if="c" style="display:none">"relu"</span><span data-if="cpp" style="display:none">"relu"</span><span data-if="com" style="display:none">"relu"</span><span data-if="dotnet" style="display:none">"relu"</span><span data-if="python" style="display:none">"relu"</span></p>
</div>
  <div class="par">
<div class="parhead">
<span id="GenParamName" class="parname"><b><code><span data-if="hdevelop" style="display:inline">GenParamName</span><span data-if="c" style="display:none">GenParamName</span><span data-if="cpp" style="display:none">GenParamName</span><span data-if="com" style="display:none">GenParamName</span><span data-if="dotnet" style="display:none">genParamName</span><span data-if="python" style="display:none">gen_param_name</span></code></b> (input_control)  </span><span>attribute.name(-array) <code>→</code> <span data-if="dotnet" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="python" style="display:none">MaybeSequence[str]</span><span data-if="cpp" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="c" style="display:none">Htuple</span><span data-if="hdevelop" style="display:inline"> (string)</span><span data-if="dotnet" style="display:none"> (<i>string</i>)</span><span data-if="cpp" style="display:none"> (<i>HString</i>)</span><span data-if="c" style="display:none"> (<i>char*</i>)</span></span>
</div>
<p class="pardesc">Generic input parameter names.</p>
<p class="pardesc"><span class="parcat">Default:
      </span>[]</p>
<p class="pardesc"><span class="parcat">List of values:
      </span><span data-if="hdevelop" style="display:inline">'bias_filler'</span><span data-if="c" style="display:none">"bias_filler"</span><span data-if="cpp" style="display:none">"bias_filler"</span><span data-if="com" style="display:none">"bias_filler"</span><span data-if="dotnet" style="display:none">"bias_filler"</span><span data-if="python" style="display:none">"bias_filler"</span>, <span data-if="hdevelop" style="display:inline">'bias_filler_const_val'</span><span data-if="c" style="display:none">"bias_filler_const_val"</span><span data-if="cpp" style="display:none">"bias_filler_const_val"</span><span data-if="com" style="display:none">"bias_filler_const_val"</span><span data-if="dotnet" style="display:none">"bias_filler_const_val"</span><span data-if="python" style="display:none">"bias_filler_const_val"</span>, <span data-if="hdevelop" style="display:inline">'bias_filler_variance_norm'</span><span data-if="c" style="display:none">"bias_filler_variance_norm"</span><span data-if="cpp" style="display:none">"bias_filler_variance_norm"</span><span data-if="com" style="display:none">"bias_filler_variance_norm"</span><span data-if="dotnet" style="display:none">"bias_filler_variance_norm"</span><span data-if="python" style="display:none">"bias_filler_variance_norm"</span>, <span data-if="hdevelop" style="display:inline">'bias_term'</span><span data-if="c" style="display:none">"bias_term"</span><span data-if="cpp" style="display:none">"bias_term"</span><span data-if="com" style="display:none">"bias_term"</span><span data-if="dotnet" style="display:none">"bias_term"</span><span data-if="python" style="display:none">"bias_term"</span>, <span data-if="hdevelop" style="display:inline">'is_inference_output'</span><span data-if="c" style="display:none">"is_inference_output"</span><span data-if="cpp" style="display:none">"is_inference_output"</span><span data-if="com" style="display:none">"is_inference_output"</span><span data-if="dotnet" style="display:none">"is_inference_output"</span><span data-if="python" style="display:none">"is_inference_output"</span>, <span data-if="hdevelop" style="display:inline">'learning_rate_multiplier'</span><span data-if="c" style="display:none">"learning_rate_multiplier"</span><span data-if="cpp" style="display:none">"learning_rate_multiplier"</span><span data-if="com" style="display:none">"learning_rate_multiplier"</span><span data-if="dotnet" style="display:none">"learning_rate_multiplier"</span><span data-if="python" style="display:none">"learning_rate_multiplier"</span>, <span data-if="hdevelop" style="display:inline">'learning_rate_multiplier_bias'</span><span data-if="c" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="cpp" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="com" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="dotnet" style="display:none">"learning_rate_multiplier_bias"</span><span data-if="python" style="display:none">"learning_rate_multiplier_bias"</span>, <span data-if="hdevelop" style="display:inline">'upper_bound'</span><span data-if="c" style="display:none">"upper_bound"</span><span data-if="cpp" style="display:none">"upper_bound"</span><span data-if="com" style="display:none">"upper_bound"</span><span data-if="dotnet" style="display:none">"upper_bound"</span><span data-if="python" style="display:none">"upper_bound"</span>, <span data-if="hdevelop" style="display:inline">'weight_filler'</span><span data-if="c" style="display:none">"weight_filler"</span><span data-if="cpp" style="display:none">"weight_filler"</span><span data-if="com" style="display:none">"weight_filler"</span><span data-if="dotnet" style="display:none">"weight_filler"</span><span data-if="python" style="display:none">"weight_filler"</span>, <span data-if="hdevelop" style="display:inline">'weight_filler_const_val'</span><span data-if="c" style="display:none">"weight_filler_const_val"</span><span data-if="cpp" style="display:none">"weight_filler_const_val"</span><span data-if="com" style="display:none">"weight_filler_const_val"</span><span data-if="dotnet" style="display:none">"weight_filler_const_val"</span><span data-if="python" style="display:none">"weight_filler_const_val"</span>, <span data-if="hdevelop" style="display:inline">'weight_filler_variance_norm'</span><span data-if="c" style="display:none">"weight_filler_variance_norm"</span><span data-if="cpp" style="display:none">"weight_filler_variance_norm"</span><span data-if="com" style="display:none">"weight_filler_variance_norm"</span><span data-if="dotnet" style="display:none">"weight_filler_variance_norm"</span><span data-if="python" style="display:none">"weight_filler_variance_norm"</span></p>
</div>
  <div class="par">
<div class="parhead">
<span id="GenParamValue" class="parname"><b><code><span data-if="hdevelop" style="display:inline">GenParamValue</span><span data-if="c" style="display:none">GenParamValue</span><span data-if="cpp" style="display:none">GenParamValue</span><span data-if="com" style="display:none">GenParamValue</span><span data-if="dotnet" style="display:none">genParamValue</span><span data-if="python" style="display:none">gen_param_value</span></code></b> (input_control)  </span><span>attribute.value(-array) <code>→</code> <span data-if="dotnet" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="python" style="display:none">MaybeSequence[Union[int, float, str]]</span><span data-if="cpp" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="c" style="display:none">Htuple</span><span data-if="hdevelop" style="display:inline"> (string / </span><span data-if="hdevelop" style="display:inline">integer / </span><span data-if="hdevelop" style="display:inline">real)</span><span data-if="dotnet" style="display:none"> (<i>string</i> / </span><span data-if="dotnet" style="display:none">int / </span><span data-if="dotnet" style="display:none">long / </span><span data-if="dotnet" style="display:none">double)</span><span data-if="cpp" style="display:none"> (<i>HString</i> / </span><span data-if="cpp" style="display:none">Hlong / </span><span data-if="cpp" style="display:none">double)</span><span data-if="c" style="display:none"> (<i>char*</i> / </span><span data-if="c" style="display:none">Hlong / </span><span data-if="c" style="display:none">double)</span></span>
</div>
<p class="pardesc">Generic input parameter values.</p>
<p class="pardesc"><span class="parcat">Default:
      </span>[]</p>
<p class="pardesc"><span class="parcat">Suggested values:
      </span><span data-if="hdevelop" style="display:inline">'xavier'</span><span data-if="c" style="display:none">"xavier"</span><span data-if="cpp" style="display:none">"xavier"</span><span data-if="com" style="display:none">"xavier"</span><span data-if="dotnet" style="display:none">"xavier"</span><span data-if="python" style="display:none">"xavier"</span>, <span data-if="hdevelop" style="display:inline">'msra'</span><span data-if="c" style="display:none">"msra"</span><span data-if="cpp" style="display:none">"msra"</span><span data-if="com" style="display:none">"msra"</span><span data-if="dotnet" style="display:none">"msra"</span><span data-if="python" style="display:none">"msra"</span>, <span data-if="hdevelop" style="display:inline">'const'</span><span data-if="c" style="display:none">"const"</span><span data-if="cpp" style="display:none">"const"</span><span data-if="com" style="display:none">"const"</span><span data-if="dotnet" style="display:none">"const"</span><span data-if="python" style="display:none">"const"</span>, <span data-if="hdevelop" style="display:inline">'nearest_neighbor'</span><span data-if="c" style="display:none">"nearest_neighbor"</span><span data-if="cpp" style="display:none">"nearest_neighbor"</span><span data-if="com" style="display:none">"nearest_neighbor"</span><span data-if="dotnet" style="display:none">"nearest_neighbor"</span><span data-if="python" style="display:none">"nearest_neighbor"</span>, <span data-if="hdevelop" style="display:inline">'bilinear'</span><span data-if="c" style="display:none">"bilinear"</span><span data-if="cpp" style="display:none">"bilinear"</span><span data-if="com" style="display:none">"bilinear"</span><span data-if="dotnet" style="display:none">"bilinear"</span><span data-if="python" style="display:none">"bilinear"</span>, <span data-if="hdevelop" style="display:inline">'norm_in'</span><span data-if="c" style="display:none">"norm_in"</span><span data-if="cpp" style="display:none">"norm_in"</span><span data-if="com" style="display:none">"norm_in"</span><span data-if="dotnet" style="display:none">"norm_in"</span><span data-if="python" style="display:none">"norm_in"</span>, <span data-if="hdevelop" style="display:inline">'norm_out'</span><span data-if="c" style="display:none">"norm_out"</span><span data-if="cpp" style="display:none">"norm_out"</span><span data-if="com" style="display:none">"norm_out"</span><span data-if="dotnet" style="display:none">"norm_out"</span><span data-if="python" style="display:none">"norm_out"</span>, <span data-if="hdevelop" style="display:inline">'norm_average'</span><span data-if="c" style="display:none">"norm_average"</span><span data-if="cpp" style="display:none">"norm_average"</span><span data-if="com" style="display:none">"norm_average"</span><span data-if="dotnet" style="display:none">"norm_average"</span><span data-if="python" style="display:none">"norm_average"</span>, <span data-if="hdevelop" style="display:inline">'true'</span><span data-if="c" style="display:none">"true"</span><span data-if="cpp" style="display:none">"true"</span><span data-if="com" style="display:none">"true"</span><span data-if="dotnet" style="display:none">"true"</span><span data-if="python" style="display:none">"true"</span>, <span data-if="hdevelop" style="display:inline">'false'</span><span data-if="c" style="display:none">"false"</span><span data-if="cpp" style="display:none">"false"</span><span data-if="com" style="display:none">"false"</span><span data-if="dotnet" style="display:none">"false"</span><span data-if="python" style="display:none">"false"</span>, 1.0, 0.9, 0.0</p>
</div>
  <div class="par">
<div class="parhead">
<span id="DLLayerBatchNorm" class="parname"><b><code><span data-if="hdevelop" style="display:inline">DLLayerBatchNorm</span><span data-if="c" style="display:none">DLLayerBatchNorm</span><span data-if="cpp" style="display:none">DLLayerBatchNorm</span><span data-if="com" style="display:none">DLLayerBatchNorm</span><span data-if="dotnet" style="display:none">DLLayerBatchNorm</span><span data-if="python" style="display:none">dllayer_batch_norm</span></code></b> (output_control)  </span><span>dl_layer <code>→</code> <span data-if="dotnet" style="display:none"><a href="HDlLayer.html">HDlLayer</a>, </span><span data-if="dotnet" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="python" style="display:none">HHandle</span><span data-if="cpp" style="display:none"><a href="HTuple.html">HTuple</a></span><span data-if="c" style="display:none">Htuple</span><span data-if="hdevelop" style="display:inline"> (handle)</span><span data-if="dotnet" style="display:none"> (<i>IntPtr</i>)</span><span data-if="cpp" style="display:none"> (<i>HHandle</i>)</span><span data-if="c" style="display:none"> (<i>handle</i>)</span></span>
</div>
<p class="pardesc">Batch normalization layer.</p>
</div>
<h2 id="sec_example_all">例程 (HDevelop)</h2>
<pre class="example">
create_dl_layer_input ('input', [224,224,3], [], [], DLLayerInput)
* In practice, one typically sets ['bias_term'], ['false'] for a convolution
* that is directly followed by a batch normalization layer.
create_dl_layer_convolution (DLLayerInput, 'conv1', 3, 1, 1, 64, 1, \
                             'none', 'none', ['bias_term'], ['false'], \
                             DLLayerConvolution)
create_dl_layer_batch_normalization (DLLayerConvolution, 'bn1', 0.9, \
                                     0.0001, 'none', [], [], \
                                     DLLayerBatchNorm)
</pre>
<h2 id="sec_predecessors">可能的前置算子</h2>
<p>
<code><a href="create_dl_layer_convolution.html"><span data-if="hdevelop" style="display:inline">create_dl_layer_convolution</span><span data-if="c" style="display:none">create_dl_layer_convolution</span><span data-if="cpp" style="display:none">CreateDlLayerConvolution</span><span data-if="com" style="display:none">CreateDlLayerConvolution</span><span data-if="dotnet" style="display:none">CreateDlLayerConvolution</span><span data-if="python" style="display:none">create_dl_layer_convolution</span></a></code>
</p>
<h2 id="sec_successors">可能的后置算子</h2>
<p>
<code><a href="create_dl_layer_activation.html"><span data-if="hdevelop" style="display:inline">create_dl_layer_activation</span><span data-if="c" style="display:none">create_dl_layer_activation</span><span data-if="cpp" style="display:none">CreateDlLayerActivation</span><span data-if="com" style="display:none">CreateDlLayerActivation</span><span data-if="dotnet" style="display:none">CreateDlLayerActivation</span><span data-if="python" style="display:none">create_dl_layer_activation</span></a></code>, 
<code><a href="create_dl_layer_convolution.html"><span data-if="hdevelop" style="display:inline">create_dl_layer_convolution</span><span data-if="c" style="display:none">create_dl_layer_convolution</span><span data-if="cpp" style="display:none">CreateDlLayerConvolution</span><span data-if="com" style="display:none">CreateDlLayerConvolution</span><span data-if="dotnet" style="display:none">CreateDlLayerConvolution</span><span data-if="python" style="display:none">create_dl_layer_convolution</span></a></code>
</p>
<h2 id="sec_references">References</h2>
<p>

Sergey Ioffe and Christian Szegedy,
"Batch Normalization: Accelerating Deep Network Training by Reducing Internal
Covariate Shift,"
Proceedings of the 32nd International Conference on Machine Learning,
(ICML) 2015, Lille, France, 6-11 July 2015, pp. 448--456
</p>
<h2 id="sec_module">模块</h2>
<p>
Deep Learning Training</p>
<!--OP_REF_FOOTER_START-->
<hr>
<div class="indexlink">
<a href="index_classes.html"><span data-if="dotnet" style="display:none;">类别</span><span data-if="cpp" style="display:none;">类别</span></a><span data-if="dotnet" style="display:none;"> | </span><span data-if="cpp" style="display:none;"> | </span><a href="index_by_name.html">算子列表</a>
</div>
<div class="footer">
<div class="copyright">HALCON算子参考手册 Copyright © 2015-2023 51Halcon</div>
</div>
</div>
</body>
</html>
